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PREFACE 


This book is an exposition of the more fimdamental and 
generally useful parts of the theory of functions of real variables. 
It also contains many useful results not generally found in the 
standard treatises on the subject. In this category are some 
of the theorems on implicit functions, differential equations, and 
Lebesgue and Stieltjes iutegrals. 

It has seemed xmdesirable to formulate the entire theory in 
the most abstract possible way, since that would make the 
content quite inaccessible to many beginning graduate students. 
However, the reader is guided toward the abstract point of view 
by the study of several postulate systems ia Chap. II and by the 
study of several function spaces in Chaps. VII and X to XII. 

Since mathematical proofs are deductive in nature, a brief 
exposition of some of the fimdamental concepts and methods of 
deductive logic is included in Chap. I. Chapter II begins with 
the postulates of Peano for the natural numbers and outlines a 
method for constructing the real number system. Chapter VIII 
contains some theorems on the extent of the domain of functions 
defibaed implicitly and a theorem on the existence of fixed points 
for continuous transformations. In Chap. IX are some theorems 
on the extent of the domain of solutions of ordinary differential 
equations. The Lebesgue integral is introduced in Chap. X by 
the method of F. Riesz, which is preferred by the author because 
it leads directly to the fundamental theorems on approximation 
and convergence. Thus the reader may learn about the main 
features of the Lebesgue integral from the first six sections of 
Chap. X. A number of miscellaneous formulas and theorems 
connected with Lebesgue integrals are collected in Chap. XI. A 
large part of Chaps. X and XI is immediately interpretable for 
the Lebesgue-Stieltjes integral of functions of several variables, 
the exceptions being marked with a ^dagger. The classical 
Stieltjes integral for functions of one variable is discussed in 
Chap. XII, and additional properties of the Lebesgue-Stieltjes 
integral are developed. A large number of convergence theorems 
are collected in Chaps. XI and XII. It has not seemed desirable 
to treat all features of the theory of integration with equal 
generality. Thus the general theory of the differentiation of 
multiple integrals has been omitted. In view of Chaps. X to XII, 
the treatment of Riemann integrals in Chap. VI may seem 
unnecessary. However, the Riemann integral is a strictly ele- 
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CHAPTER I 
INTRODUCTION 

1. The Purpose of an Introductory Course in the Theory of 
Functions. — The foUomng chapters are written with a threefold 
purpose in mind. The iSrst is to afford the student a survey of 
the field of analysis from its foundations. Modem analysis is 
based on the system of natural numbers and its properties. In 
Chap. II is outlined a method for constmcting the real number 
system and for proving its properties on the basis of the proper- 
ties of the system of natural numbers. The second purpose is 
to review the fundamental concepts and theorems of the calculus. 
The reader is supposed to have reached the stage where he can 
understand precise statements of these fundamental concepts and 
rigorous proofs of the theorems. In the following chapters are 
included some theorems for which fallacious or incomplete proofs 
are frequently given in elementary calculus texts. The third 
purpose is to acquaint the student with the theorems and the 
methods of investigation that are fundamental for modem 
research in analysis. These theorems and methods are fre- 
quently used also in other branches of mathematics and in the 
applications of mathematics. 

It should be emphasized that mathematics is concerned wdth 
ideas and concepts rather than with symbols. Symbols are tools 
for the transference of ideas from one mind to another. Concepts 
become meaningful through observation of the laws according 
to which they are used. This introductory chapter is concerned 
with certain fundamental notions of logic and of the calculus of 
classes. It will be understood better after the student has 
become familiar with the use of these concepts in the later chap- 
ters. Consequently it is recommended that after a bird's-eye 
view of the contents of Chap. I, the student should pass on to a 
study of Chap. II, returning to Chap. I from time to time as 
occasion arises. 

Numbers in brackets refer to the list of references at the end 
of the chapter. 
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2. Fundamental Logical Notions. — ^Logic is largely concerned 
with, the study of the laws governing the use of logical connectives 
or operators which apply to statements to form more complex 
statements/^^ The situation is quite analogous to elementary 
algebra, which is concerned with the laws governing the opera- 
tions of addition, multiplication, etc., as applied to numbers. 

As undefined operations on statements, whose meaning is 
generally understood, w-e may take negation, conjunction, and 
alternation. If p and q denote statements, the negation of p 
is denoted by — p (or sometimes by ^ p, or by p'). The con- 
junction of p and q is denoted by p.g, read ^'p and qJ^ The 
alternation of p and q is denoted by p V g, read ^'p or g.’’ We 
wish to consider these operations independently of the truth or 
falsity of the statements p and q. To make the meaning of 
p V g completely unambiguous it is perhaps necessary to remark 
that the statement p V g is true when p and q are both true as 
well as when only one of them is true. 

Other logical connectives or operators may be defined in terms 
of those already given. The conditional is denoted as follows: 
p D g, which may be read ^'p only if or ''if p then qJ^ This 
is defined to mean 

-p V g. 

Thus of the following four conditional statements: 

(2:1) If 1< 2, then 3 < 4, 

(2:2) If 2 < 1, then 3 < 4, 

(2:3) If 1< 2, then 4 < 3, 

(2:4) If 2 < 1, then 4 < 3, 

only (2:3) is false, while the other three are true. The words 
"implies’^ and "implication^’ have not been used in the above 
discussion because they have been used by different authors with 
different meanings and have given rise to some controversy and 
misunderstanding. 

It should be noted that the symbols or formulas 
p V g and V 0 <1 

1 In what follows, the words “statement,” “proposition,” and “sentence” 
are considered as synonymous. Some writers on logic prefer one, some 
another. Quine [2] defines statements as those sentences which are true 
and those which are false. 
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etc., are not themselves statements. They become statements 
only when specific statements are substituted for the symbols p 
and g, i.e., when p and q are taken to stand for specific state- 
ments. The same is true of 

(2:5) -(p. -p), 

(2:6) p V -p. 

However, we may form statements from (2:5) and from (2:6) in 
another way by prefixing the words “Whatever statement p is, 
. . . or “For every statement p, . . . The statements 
formed in this way happen to be true in both these cases. Irre- 
spective of their truth or falsity, they are said to be formed from 
(2:5) and (2:6) by application of the universal quantifier and 
are frequently written as follows: 

(2:7) (p). -(p. -p), 

(2:8) (p). p V -p. 

The variable p in (2:5) and (2:6) is called a real or free variable, 
while in (2:7) and (2:8) it is said to be apparent or bound. There 
is some question as to whether in the use of the universal quan- 
tifier, the variable that is bound by it may be allowed to stand 
for any entity whatever. The use of the notion of the “class of 
all entities whatever’^ leads to contradictions if no safeguards 

are set up. Different types of safeguards have been proposed 

by various workers in logic. However, it is clear that if p is 
replaced in (2:5) or (2:6) by the number 3 or by the concept 
fright, the result is not a statement. In the formulas (2:7) and 
(2:8) the universal quantifier refers implicitly to the class of all 
statements p. In noiathematical practice it turns out that when- 
ever the universal quantifier occurs it may always be taken to 
refer to some specific class of objects, which is generally recog- 
nized to be sufficiently well determined to be the subject of dis- 
course. This class should be explicitly indicated whenever its 
nature is not sufficiently obvious from the context. The method 
of procedure just iadicated seems to be a practical way of avoid- 
ing the paradoxes. It is desirable to use specific classes as the 
subjects of discourse but, since it is always possible to imagine 
new objects which are not members of a given class, no such 
class can be regarded as the universal class. For the same reason 
the objection may well be raised that the class of all statements 
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2 >, referred to above, is not a well-determined class. In many 
ways a pragmatic approach to mathematics seems preferable to 
that of the modem logicians and is in practice adopted by most 
mathematicians, either consciously or unconsciously. The work 
of the logicians is none the less valuable and interesting. 

Another logical operator of importance is the biconditional, 
for which we use one of the notations: p g, or p = g. This 
is to be read ^‘p if and only if and is defined to mean 

pD q-q Dp- 

We shall use the symbol for this operator except in defini- 
tions, where the other symbol “ s ” will be used, with the s 3 Tnbol 
whose use is being defined placed to the left of the sign. 

The following important logical laws relate to the various 
operators we have been discussing. They hold for all statements 
p, q, and s. For convenience the symbol for the universal quan- 
tifier is omitted in stating these laws. This omission is quite 
frequently practiced in mathematical writing and will cause no 
confusion. 


(2:9) 

( 2 : 10 ) 

( 2 : 11 ) 

( 2 : 12 ) 

(2:13) 

(2:14) 

(2:15) 

(2:16) 

(2:17) 

(2:18) 

(2:19) 

( 2 : 20 ) 

( 2 : 21 ) 

( 2 : 22 ) 


(p.q) ~ (q.p). 

(p V g) ~ (g V p). 

(pr-^q) p). 

_(_P) 

-(p. -p). 

p V — p. 

-(p.q) ~ (-P V -g). 
-(p V g) ~ (-p. -g). 

(p D g) ~ (-g'O -p). 
-{p D g) ~ (p. -g). 

(p V g) V s ~ p V (g V’ s). 
(p.g).s ~ p.(g.s). 

(p V g).s (p.s) V (g.s). 
(p.g) V s ~ (p V s).(g V s). 


The first three, (2:9), (2:10), and (2:11), state properties of 
symmetry for ., V, and i.e., they are commutative laws; 
(2:12) is the law of double negation; (2:13) is the law of con- 
tradiction; (2:14) is the law of the excluded middle; (2:16) and 
(2:16) are called de Morgan’s laws; (2:18) is the law of contra- 
position for the conditional; (2:19) and (2:20) are associative 
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laws; and (2:21) and (2:22) are distributive laws. Note that we 
are here asserting these statements to be true. The assertion 
or denial of a statement is a statement about a statement, and 
so differs from such an operation as the negation of a statement, 
which transforms a statement into another statement. Thus 


differs from 


“Jones is ill'^ is false, 
— (Jones is ill). 


For the study of logic and its structure, it is interesting to note 
that all the operators we have been discussiug may be defined in 
terms of a single operator, called “joint denial,’^ which is denoted 
by (v i q)} read “neither p nor The three operators that 

we have previously taken as primitive may be defined in terms of 
this new operator as follows: 

(2:23) -P = (l>i p). 

(2:24) (p.q) s (-p J, -g). 

(2:25) (pV q) = -ip i q). 

On the basis of these definitions the law of the excluded middle 
becomes a formal consequence of the laws of double negation and 
of contradiction. The meaning of the operator ( i ) may be 
defined by means of a truth table, giving the truth value of the 
statement (p ], g) iu terms of the truth values of p and q, as 
follows. Here “T^^ stands for “true^^ and “F’’ for “false.’^ 


p q 

T T 
F T 
T F 
F F 


(p i q) 
F 
F 
F 
T 


Thus all the logical operators so far mentioned, except the uni- 
versal quantifier, are definable by means of truth tables, and the 
relations between them may be derived by means of truth tables, 
so that if we use the definitions (2:23) to (2:25) above, all the 
logical laws (2:9) to (2:22) are implicitly contained in the truth- 
table definition of ( i ). 

A system which could perhaps be called a system of logic can 
be constructed on the basis of a truth table with three or more 

^ See, for example, Quine [3], pp 45jf. 
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kinds of entries. In such a system more types of operators 
present themselves for consideration.^^^ 

Another quantifier of frequent occurrence is the existential 
quantifier. If q{x) is a statement form or “propositional func- 
tion involving a variable the symbol 

(2:26) 3rrag(x) 

is read “there exists x such that q{x)J^ The symbol 3 is read 
“there exists'' and the symbol ? is read “such that." The sym- 
bol a may be used also in other situations to connect a property 
or a statement to an entity. It is interesting to note that the 
existential quantifier may be defined in terms of the universal 
quantifier and the operation of negation. That is, in terms of 
symbols, the formula (2:26) may be defined to mean 

(2:27) -m.-q(x)]. 

It is important to be familiar with this relation between (2:26) 
and (2:27), especially in connection with the making of indirect 
proofs. Formulas (2:15) to (2:18) are also frequently used in 
the making of indirect proofs. 

It has already been mentioned that the symbol for the uni- 
versal quantifier will sometimes be omitted. Where it is neces- 
sary to indicate this operator, we shall adopt the convention that 
it is implicit in the conditional and the biconditional. Thus in 
stating the commutative law for addition we shall write 

a + 6 = 6 + a. 

This always refers to the elements a and & of a particular class 
9)i of numbers. In the strict notation of logic this commutative 
law is written 


{a).(b),a€Wl . be^SR Da + & = 6 + a, 

where the symbol “aeSft" means “a is a member of 3)?." Since 
we are taking the universal quantifier always to refer to a 
specific class, the initial symbols “(a). (6)" may as well be 
omitted. The statement 

aeSK . be^Sfi Oa + b^b + a 

1 See, for example, Lewis and Langford [7], pp. 213-234; Bennett and 
Baylis [4], p. 278. 
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may be regarded as a relation of implication between two proper- 
ties. It may be true or false, depending on the meaning assigned 
to and This notion of implication is not the same 

as any of the notions of material implication, strict implication, 
or logical implication. A discussion of these notions is not essen- 
tial for our purposes and will be omitted. 

Treatises on logic usually include a formal analysis of the 
relation of class membership, symbolized by and the relation 
of identity, symbolized by This formal analysis sets forth 

the rules applicable to these relations, but the intuitive under- 
standing of the meaning of these notions remains fundamental for 
reasoning. Some writers on mathematics do not use the symbol 
“ = for identity, but define the meaning of the symbol by means 
of postulates. In the present work this symbol will be used only 
to indicate the relation of identity, that is, means that a 

and h are symbols standing for the same thing. 

3. The Class Calculus. — The meaning of the notions of a class 
and of class membership will be taken as commonly imderstood. 
These notions are fundamental in logic and mathematics. The 
terms ''set,’’ "collection,” "family,” and "aggregate” will ordi- 
narily be understood to be synonymous with ^^class.” Classes 
are frequently defined by means of the properties possessed by 
their elements, i.e., by means of propositional functions. If q^{x) 
denotes a propositional function or statement form involving the 
variable x, such a definition of a class may be given the following 
form: The class A is defined to consist of all those elements x such 
that g(a:) is true. The unguarded use of such definitions leads to 
paradoxes, as in the case of the following: The class A consists 
of all those classes x such that x is not a member of x. We shall 
avoid such difficulties by refraining from using the unrestricted 
variable, that is, in using the form of definition now being dis- 
cussed, we shall restrict the variable x to range over a definite 
preassigned class U, The class A defined in this way is then a 
well-defined subclass of U, provided the statement form g(x) is 
properly constructed. The use of good judgment in deter m i n i n g 
when a statement form is acceptable in defining a class seems to 
be unavoidable. Thus the class of all x who are living humans 
and have blue eyes is not well determined for mathematical 
purposes, although the property in question is a practically useful 
one as an aid to identification. One difficulty lies in drawing the 
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boundary line between blue eyes and gray, and another lies in 
determining which people are living at any particular instant, 
since people are continually being born and dying. 

Other methods of defining classes are of course needed and 
will be met in the following chapters. For instance, it is usually 
admitted that the class of all subclasses of a given class forms a 
well-defined class. 

Parallel to the operations on statements previously discussed 
are certain operations on classes. The sum of two classes A and 
jB is a class A + B consisting of those elements which are mem- 
bers of A or of B. The complement cA relative to a “universal” 
class [7 of a subclass A oi U consists of those elements of U which 
are not members oi A, If the subclass A is identical with U 
itself, its complement cA cannot have any members. It is con- 
venient to postulate one definite class, called the null class, 
having no members, and to agree that it shall be considered as a 
subclass of every class. We shall denote the null class by the 
symbol A, or sometimes by 0. Thus if J7 is the universal class 
of a given discussion, cC7 = A. The difference A — B oi two 
classes A and B consists of those members of A which are not 
members of B, Such a difference may of course reduce to the 
null class. The product AB of A and B consists of those elements 
which are members of both A and B, Sums and products of 
classes obviously obey the usual commutative and associative 
laws of algebra. Moreover, there are two distributive laws: 

(3:1) A(B + C) ^AB + AC. 

(3:2) A+BC ^ {A + B){A -h C). 

Care must be taken wfith the operation of taking the difference, 
because it does not obey the usual laws of algebra relating to 
subtraction. 

The operations of taking sums and products of sets may be 
extended in an obvious way to quite arbitrary collections of sets. 
Thus if {Aa} denotes a collection of classes distinguished by the 
different values taken by the index a, the sum of the classes Aaj 

denoted by ^ A a, consists of all elements x such that there exists 
an a such that x is sl member of A a- The product, denoted by 
n consists of all elements x that are simultaneously members 
of all the classes A a- When the definitions are phrased in this 
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way, there is no question of proving commutative or associative 
laws. 

The Cartesian product P X Q of two classes P and Q consists 
of all ordered pairs (p, q) of which the first element p is a member 
of P and the second element g is a member of Q, 

The relation 


A is a subclass of B 
is indicated by one of the notations 

A C B or PDA. 

As previously indicated, there is a close connection between 
the operations on classes and the logical operations on statements. 
Let U be a class of elements x, and let P, Q, and R consist of 
those elements x of U for which the statements p(a;), q(x), and 
7'{x)j respectively, are true. In the following symbolic state- 
ments we adhere to the convention already mentioned that the 
universal quantifier is implicit in the conditional and the bicon- 
ditional. If 

r(x) p(x) V q{x) 
is true, then P = P + Q* If 

t{x) ~ pix),q{x) 
is true, then R = PQ. If 

r{x) ^ —p(,x) 

is true, then R = cP. If 

(3:3) X D p{^) 

is true, then P ^ U. If 

(3:4) 3x9 — p{x) 

is true, then cP 5 ^ A. As was indicated in the preceding section, 
the statements (3 :3) and (3 :4) are the negatives of each other. 
This simple principle is an important one and frequently needs to 
be applied several times in an indirect proof. If 

p(x) D q(x) 
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is true, then P C. Q. The laws 

(3:5) ccP = P, 

(3:6) PcP = A, 

(3:7) P + cP=i7, 

(3:8) c{PQ)=cP + eQ, 

(3:9) c(P + Q) = mm, 

(3:10) P C Q ^ cQ C cP, 

correspond, respectively, to the laws (2:12), (2:13), (2:14), (2:15), 
(2:16), and (2:17) of Sec. 2. 

The notion of a class of counters is fundamental for mathe- 
matics and may be set up formally in the following way. Let the 
null class be denoted by 0, the class whose sole element is 0 by 
{ 0 } , the class whose sole element is { 0 } by { { 0 } } , and so on. The 
counter class C is the class [0, {0}, {{0}}, . . .]. It may be 
defined as the product of all classes B having the following two 
properties: 

(i) The null set 0 is a member of B; 

(ii) If a is a member of S, the class {a}, whose sole element is 
a, is also a member of B, 

The existence of a class B having the properties (i) and (ii) is an 
assumption, called the axiom of infinity. The counter class C 
has a number of familiar properties which will be discussed in 
Chap. II. The elements of C may be considered as representing 
the natural numbers. A satisfactory definition of the natural 
numbers seems to be as elusive as a definition of space or time. 
We can however readily set down the laws according to which 
we use the natural numbers, just as we set down rules for measur- 
ing space and time. 

At this point mention should be made of a logical assumption, 
known as the ''axiom of Zermelo,'^ the "axiom of choice,'' or the 
"multiplicative axiom," which enters into many mathematical 
proofs. One form of its statement is as follows: 

For every family of nonnull classes A a, no two of which have 
an element in common, there is a class B which has exactly one 
element in common with each class A«. 

A few parts of analysis have been reconstructed by some writers 
so as to avoid the use of this assumption. For many proofs 
it is sufficient to assume its validity when only a denumerable 
infinity of classes A a are considered. 
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4 . Relations and Functions. — There are many instances of 
relations occurring in mathematics. An important example is 
the order relation between real numbers, denoted by <.” If 
the class of real numbers is denoted by J?, then < is a relation on 
RR. It is called a “binary” relation because it involves pairs 
of elements. Just as a property may be regarded as consisting 
of the class of elements having that property, so a relation may 
be regarded as consisting of the class of ordered pairs for which 
the relation holds true. Thus the relation < between real num- 
bers consists of the points in the rc^-plane lying above the line 
X = y. In general a binary relation on PQ is a subset of the 
Cartesian product P X Q- 

A ternary relation consists of a class of ordered triples of ele- 
ments. An example is the geometric relation of collmearity. 
This relation has properties of symmetry which mean that the 
order of the elements is not significant. A ternary relation on 
PQR may be regarded as a binary relation on SR, where S is the 
Cartesian product P X Q- 

If we admit to consideration multiple-valued functions, as it 
is frequently convenient to do, a fimction is nothing more nor 
less than a relation. The only difference is in the notation, 
terminology, and emphasis. For example, a relation on PQ may 
be written ta the functional notation as simply 

(/(p)binP), 

where it is rmderstood that /(p) stands for the set of all the ele- 
ments in Q to which p bears the given relation. If P and Q both 
consist of all the real numbers and the relation is <, then/(3:?) 
is the set of all numbers q > p- The subset Pq of P consisting 
of aU those elements p for which f{p) 5*^ A is called the domain 

of the function /. The range of / is the set Qo = ^f(p)- When 

the set f(p) is singular or null for every p, the function f is said 
to be single-valued. The inverse function/""^ of / is the relation 
obtained by reversing the order in the pairs for /. Thus the 
domain of is the range of /, and vice versa. For example, 
if for each p, f(p) is the set of all numbers q > p, then is 
the set of aU numbers p < q- If /(p) == sin p, where the domain 
is the set of all real numbers, then the range is the interval 
— 1 ^ ^ 1, while, for the uxverse function sin""^ g, the domain 
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is the interval — 1 ^ g S 1 and the range is the set of all real 
numbers. When both / and are single-valued; the function 
establishes a one-to-one correspondence between Po and Qo- A 
single-valued function having domain P and range contained in 
Q is frequently referred to as ^‘a function on P to 
6. Resume of the Symbols for Logical Connectives. — The fol- 
lowing list of logical symbols and their readings will be useful 
for reference: 



or 

and 

not 

only if ; if . . . then . . . 

if and only if 

is defined to mean 

there exists 

there exists uniquely 

such that 

is a member of 

is a subset of (between classes). 


The reader has no doubt observed that in the more complex 
logical statements, brackets are frequently needed. In most cir- 
cumstances it is desirable to replace the brackets by a system of 
dots, for greater ease in reading and writing the notation. The 
more inclusive brackets are indicated by the larger number of 
dots. The symbols D and ^ will always be accompanied by 
dots on both sides. The same will be true for the symbol s 
except when it is used in defining the symbol for an entity or a 
class. The symbol ? will ordinarily be accompanied by dots on 
the right only. The symbols D, =, and V are regarded as 
superior to the symbol a having the same or a fewer number of 
dots, while ^^and,” which is symbolized by dots only, is inferior 
to all other symbols accompanied by the same or a greater num- 
ber of dots. A few examples will make the usage clear. Thus 
if B denotes the class of real numbers, the statement 


9- yeR < x 

is interpreted to mean ''there exists y such that [y is in P and 
< a;].” The statement as a whole expresses a property of the 
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element x. It may form a part of a more complex statement, 
such as the follo\\ing: 

(5:1) X r. xeR : "By r yeR .y^<x:'^: zeR O * a: > —2^. 

Here the universal quantifier is understood to apply to each of 
the variables x and 2, and the class R over 'w^hich they range is 
explicitly indicated. The statement (5:1) written out explicitly 
with brackets reads: ‘Tor every x, (if {x is in iJ and there exists 
y such that [y is in B and y^ < x]} then {for every 2 [if is in J? 
then X > — J3^]}).” If all the letters are imderstood to stand 
for real nunlbers, the statement (5:1) may be compressed as 
follows: 

(5:2) X9:3y 9- < x : D : 2 O * ^ 

This may be read as follows: “if x is such that there exists y 
such that y^ < x, then for every z,x> The same mean- 

ing may also be conveyed with a different construction, as 
follows: 

(5:3) X.5J : D : By 9* 2 /^ < X O • ^ > 

If /(x) is a real-valued function of the real variable x, the defini- 
tion of the property of continuity of / at a point h may be written 
as follows, if P is used to denote the subclass of R consisting of 
the positive numbers: 

(5:4) ecP :D:3d9:d€P :x€fi. lx - 61 < dO- \fix) -/(6)1 < e. 
The dots are used to indicate the following bracketing: 

eeP D {3d 9 [deP.{[xeB. lx - 6| < d] D |/(x) - /(6)1 < e}]}. 
The negative of the statement (6:4) is 

(5:5) 3e 9: eeP : deP O ' 3x 9* xeP. lx — 61 < d. |/(x) — /(6)| ^ e. 
The statement (5:4) is ordinarily abbreviated as follows: 

(5:6) e > 0 : ^ ; 3d > 0 9: lx — 61 < d O * !/(a:) — /(6)1 < e. 

Exercises 

Write the negative of each of the following statements in a 
form in which no logical connective appears on the right of a 
symbol for negation. The symbols x, 2/, and z are understood 
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to stand for numbers of a class M for which an operation of 
multiplication and an order relation are defined. 

1 . X < X, 

2. X .y xy ^ yx. 

3. a; . 2/ O ■ 9* a;;s = 2/- 

4. 3a; ?: 2 / * D ■ ^ 2 / = 

5. 3s9: xy = X = zV y — z, 

6. X 9^ y ''2)' X < y y y < X. 

7. a; < 2 / O * 3^ a- a; < a: . 2 ; < 2 /. 

*6, Remarks on Various Bases for Logic. — In the preceding 
sections occasional hints have been given of the problems of 
modern logic. There is no general agreement on the best solu- 
tion for these problems. In fact mathematical logic is a field in 
which controversy is still both possible and profitable. 

Some of the problems are raised by the paradoxes that occur 
in the general theory of classes and of propositions. These para- 
doxes arise from the consideration of unrestricted variables, the 
universal class, statements that refer to themselves, and classes 
that are members of themselves. It seems clear that a statement 
that refers to itself is not a sensible statement, and so should be 
excluded from discourse. Also the members of a class must be 
themselves well-determined before the class containing them as 
members can be specified, so that it does not make sense to speak 
of a class that is a member of itself. When any given class of 
entities is presented for consideration, it is thereupon possible to 
conceive of a new entity not present in the given class. This 
ability of the human mind continually to create new concepts 
indicates that the concept of a universal class containing all 
entities is not a useful one. In any particular theory, mathe- 
matics deals with fixed classes, and the results have been satis- 
factory to most people. 

Many workers in logic would differ from the common-sense ’’ 
point of view expressed above. For example, Quine (see [3], 
pages 163-166) seems to prefer the following criteria of accept- 
ability of a system of logic: (1) it should preserve the unrestricted 
variable and the universal class; (2) it should be as simple and 
general as possible while still containing rules that prevent 
paradoxes from entering the system. Although Quine’s rules in 
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[3] are not sufficient to keep out paradoxes, they do prevent some 
entities from being members of classes. Moreover, they seem 
to make the meaning of the notion of class membership somewhat 
different from that ordinarily assigned to it. Russell proposed 
a theory of types as a means of keeping out the paradoxes. His 
theory has been widely discussed but has not been foxmd uni- 
versally acceptable. 

The intuitionist school, led by Brouwer and Weyl, maintains 
that many of the processes of reasoning commonly used by 
mathematicians are lacking in justification. For example, it is 
admitted that one can conceive of as many natural numbers as 
one wishes and that consideration of these numbers is justifiable. 
But objection is raised to the consideration of the class of all 
conceivable or possible natural numbers as a definite closed sys- 
tem. (See Weyl [11], pages 246-249.) Objection is also raised 
to the use of infinite logical sums and products and to the con- 
sideration of the class of all subclasses of a given infinite class. 
These concepts are fundamental for the construction of the 
continuum of real numbers, and so for much of modem mathe- 
matics. Thus they have at least a pragmatic justification. But 
for the intuitionists their logical justification is lacking. 

An explicit axiomatic basis for the theory of classes as com- 
monly used by mathematicians was formulated by Zermelo (see 
[12]; also Fraenkel [9], Chap. 5, pages 268#.; Quine [3], pages 
163-166). In this basis there is no fixed universal class. The 
use of infinite classes and of infinite processes is justified by the 
pragmatic criterion that these concepts have proved useful in 
exploring and understanding the world of thought and also the 
world of sense. It is nevertheless interesting and valuable to see 
what can be done with a more cautious procedure and a more 
critical point of view. 


References 

1. Tarski, Introduction to Logic, 1941. 

2. Quine, Elementary Logic, 1941. 

3. Quine, Mathematical Logic, 1940. 

4. Bennett and Baylis, Formal Logic, 1939. 

5. Whitehead and Russell, Principia Mathematica. 

6. Russell, Principles of Mathematics, 2d Ed., 1937. 

7. Lewis and Langford, Symbolic Logic, 1932. 

8. EKlbert und Ackermann, Grundzuge der theoretischen LogiJc, 2d Ed., 1938. 



16 


INTRODUCTION 


[Chap. I 


9. Fraenkel, Einleitung in die Mengenlehre, 3d Ed., 1928. 

10. Brouwer, ^‘Intuitionism and Formalism,” Bulletin of the American 
Mathematical Society , Vol. 20 (1913), pp. 81-96. 

11. Weyl, ^‘Consistency in Mathematics,” The Rice Institute Pamphlet, 
Vol. 16 (1929), pp. 245-265. 

12. Zermelo, ^‘Grundlagen der Mengenlehre,” Mathematische Annalen, 
Vol. 65 (1908), pp. 261-281. 

Tarski [1] and Quine [2] give useful introductions to the ideas and methods 
of modern logic. Although Quine^s treatise [3] involves a contradiction, its 
first three chapters form an extremely clear and acceptable textbook on the 
subjects they cover. Much space in Bennett and Baylis [4] is taken up with 
a discussion of classical logic and with ingenious exercises in deduction. 
However, this work gives a fairly good exposition of the ideas and methods 
of modern logic in its latter part. Whitehead and Russell’s Prinaipia [5] 
is a monumental work, intended to exhibit how the various branches of 
mathematics may be built up out of purely logical notions. Russell’s 
Principles [6] is an earlier work. The reader should note in the introduction 
to its second edition the author’s outline of how his stand on various prob- 
lems of logic has changed. The system of strict implication is explained at 
length in Lewis and Langford [7], and the formalist point of view in logic is 
expounded in Hilbert and Ackermann [8]. Quine [3] gives a useful bibli- 
ography on logic including a reference to the more complete bibliography by 
Church. 



CHAPTER II 

THE REAL NUMBER SYSTEM 


1. Introdijction. — In this chapter we shall show how the real 
number system may be constructed and its properties proved on 
the basis of assumed properties characterizing the S 3 ^stem of 
natural numbers (positive integers). The process used in the 
following pages is not the only one that may be followed in 
constructing the real number system. Other methods are 
explained in the references given at the end of the chapter. The 
properties of the real number system proved in Secs. 2 to 9 are 
summarized in Sec. 9. These properties form a categorical set, 
in the sense that any two systems that satisfy them are simply 
isomorphic. For mathematical purposes, then, the real number 
system is simply a system having the properties set forth in 
Sec. 9. The reader who so desires may omit most of Secs. 2 to 8, 
since the properties of Sec. 9 form a logical basis for all the 
remainder of the theory. In Secs. 2 to 8 we gain assurance of 
the existence Of the real number system, since most of us are 
satisfied with the abstraction we call a natural number, and with 
the properties of the natural numbers listed in Sec. 2. Moreover 
in the process we discover the logical relationship of the various 
systems: natural numbers, fractions, and real numbers. 

As the notion of simple isomorphism occurs frequently in this 
chapter, we define it here for several types of systems. Let 3K 
and W be two classes of elements, and let s be a function on 9K 
to 9K, / be a function on to 9K, and < be a relation on 3K3K, 
while s', f, and <' denote corresponding functions and a relation 
for W, Then (a) (501, s), (6) (9K,/), (c) (50i, <) are, respectively, 
simply isomorphic to (a) (311', s'), (h) (501',/'), (c) (501', <') in case 
there is for each case a one-to-one correspondence between 501 
and 501' such that (a) s(m) corresponds to s'(m'), (b) f(m, n) 
corresponds to/'(m', n'), {c) m < n]£ and only if m'<'n', where 
m corresponds to m' and n to n' under the correspondence appro- 
priate to the case in question. A system (501, s,f, <) is simply 
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isomorphic to a system (2)?', s', <') in case the correspondence 

can be set up in such a way that the three conditions hold simul- 
taneously. This indicates how simple isomorphism is defined 
for other types of systems. 

2. The Natural Numbers. — ^We assume the existence of a 
system s), where 30? is a class of elements ??^, n, . . . , and 
s{m) may be called the successor of m, having the following 
properties: 

PI. s is a function on 2)? to 2)?; that is, to each m in 2)i cor- 
responds a uniquely determined element s{m) in 2)t. 

P2. 3mo 9: m O ' ^(m) 7 ^ mo; that is, there is an element mo 
in 211 which is not the successor s(m) of an element of 2K. 
If we let s21lo denote the set of all functional values s{m) 
corresponding to elements m of the set 2Jlo, this state- 
ment may also be written as follows: 211 — -s2K 9 ^ A. 

P3. 5(m) == s{n) O * ^ that is, there is at most one 
element of 21i having a given element of 2}i as its successor. 

P4. 2iio c m.Bmo c 2Ro . 2iio[2ii - sm] AO*aiio - m; 

that is, if 21io is a subclass of 21i which contains the suc- 
cessor of each of its elements, and which furthermore 
contains an element mo satisfying P2, then 2rto is the 
whole of 211. 

These postulates are essentially due to Peano. The fourth 
property is the basis for all proofs by mathematical induction. 
The counter class C discussed in Sec. 3 of Chap. I, with s(m) 
= {m}, is an example of a system having these properties. 

The following three additional properties are immediate con- 
sequences of the Peano postulates: 

P5. 2Ko C 9K . 2 II 0 A O * 3Ko — s21fo 9 ^ A; that is, every 
nonnull subclass 21io of 21l' contains at least one element 
that is not the successor of an element of 2)lo. 

P6. The class 2U — s21l contains only one element mo. 

P7. m O* s(m). 

To prove P5, suppose 21lo — s21io = A, so that 21io C s21io, 
and let 21ii = 2ft - 2fto. Then 2ftO 2ft - s2ft. By P3, s2fto 
and 52fti have no elements in common, so that 2fti D s2fti. 
Hence by P4, 2fti = 2ft, and 2fto == A, which contradicts the 
hypothesis. To prove P6, let mo be an element of 2ft — s2ft, and 
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set SDio = {mo} + sSD?. Then sSWo C 9Ko, so that 9Ko = 9K by 
P4, and hence is the only element of which is not in siDi. 
To prove P7, let 9Ko = [all m s{m) ^ m]. Then 2)io contains 
the element mo described in P2, and s(m) 9 ^ m • ‘2> • s{s{m)) 
9 ^ s(m) by P3. Hence s3Wo C 90?o, and 9Ko = 2)i by P4. 

It is easily seen that any two systems satisfying PI to P4 are 
simply isomorphic, so that these four postulates form a cate- 
gorical set. It may also be proved that PI, P5, and P6 imply 
P2, P3, and P4, so that the principle of mathematical induction 
may be regarded as a theorem if one so desires. 

It is 'instructive to note examples where one or more of the 
preceding properties fails to hold. In each of the following 
examples 3K = [m] is a class of numbers, and s(m) = m + 1 
except where otherwise specified. 


A. 

m 

= [i, 

2 , 

3]. PI 

fails, 

since 

s(3) is not in 2)?. 

B. 

m 

= [i, 

2 , 

3], “with 

s(3) 

= 1. 

P2 and P5 fail. 

C. 

m 

= [i, 

2 , 

3], with 

s(3) 

= 2. 

P3 and P5 fad. 

D. 

m 

= [i, 

2 , 

3], with 

s(3) 

= 3. 

P3, P5, and P7 fail. 

E. 

m 

= [i, 

2 , 

3, 4, • • 

f 

• •]. P4 and P6 fail. 

F. 

an 

= li, 

1 , 

2, 8, 4 

} 

•], with s(i) = 2. P3, P4j 


P6 

fail. 







In a system (501, s) having the properties PI to P4, operations 
of addition and multiplication and a relation of order may be 
defined. We proceed first to define addition by requiring it to 
satisfy the following condition: 

(2:1) p . m O ' P + mo = s(p) . p + s(m) = s(p + m). 

It wiU be noted that with this definition of addition, the element 
mo behaves as 1 , whereas in the coimter class C the first element 
is the null class 0. In succeeding sections it is convenient to 
defer the introduction of zero as long as possible. 

The operation of addition has the following properties: 

Ml. + is on 502SD? to 50i; that is, for each p and m in 501 there 
is a uniquely determined element p + m in 50i. 

M2. + is associative; that is, m . n . p O * (m + n) + p 

= m + (n + p). 

M3. + is commutative; that is, m . p O * m -[- p = p + m. 

M4. m.pO*P7*^m + p. 

M5. m 7 *^ p : D : m + O' ~ p • V * 9 - m == p -h n. 
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M6. m-l-n = m + 390‘^ = P; that is, the result of sub- 
traction is unique. 

To prove the uniqueness in Ml, suppose + and © are opera- 
tions satisfying (2:1), and for a fixed p, let SD?o = [all mr p + m 
= p © m]. Then mo is in 9Ko and, if m is in SUio, p + s{m) 
= s{p + m) = s(p ® m) = p © s{m), so that s{m) is in Tto. 
Thus 9Jio = by P4. To show the existence of an operation 
+ having the property (2:1), let denote the class of all ele- 
ments p for which there exists an operation + such that p + mo 
= s(p), and p + s{m) = s(p + m) for every m. To show mo is 
in 2)?i we may take mo + m = s(m). Then mo + s(m) = s(s(m)) 
= s(mo + m). If p is in 9Wi, we may set s(p) + m = s(p + m). 
Then s(p) + mo = s(p + mo) = s(s(p)), s(p) +,s(m) = s(p -f 
s(m)) = s(s(p -f m)) — s(s(p) + m). Hence s(p) is also in 
9Jli, and SJJi = SOI by P4. Note that in the course of proving Ml 
we have proved that 

(2:2) p.m • D • s(p) -h m = p ■+• s(m). 

To prove the associative law M2, let m and n be fixed and let 
2Ko « [all p 9* (m -f n) p = m -t- (n -b p)]. Then mo is in 
9JJo since (m + n) + mo — s(m + w) == m + s{n) = m H- (n + 
mo). If p is in 2Ko, (m + n) + s(p) = ${(m + n) + p) = s(m 
+ (n + p)) = m + s(n -b p) = m + (n -b s(p)). Thus S!Ko = 
9K by P4. 

The proof of the commutative law M3 requires a double appli- 
cation of P4. We first prove by use of (2:2) that the class 
2)ip s [all m 9* p -b m = m -b p] has the property that 
C 9Kp. Next, it is obvious that contains mo, so that 
= 9)1 by P4. Thus mo is in every 9Kp, and SOtp = 9)1 by another 
application of P4. 

To prove M4, let 9)lo = [all p 9* p 7^ m + p]. Since mo 7^ s(m) 
= m -b mo, mo is in 9}lo. By P3, s9)lo C SWo, and thus 3)io = 9)1 
by P4. 

In considering the property M5, we shall let p be a fixed ele- 
ment of 3)1, and set 9)li == {p}, 3)12 = [all m 9: 9- m + g = p], 

9)13 = [all m 9: 3n 9* m = p + n\ 3)lo = 9)li + SW2- + 3)18. If p 
- mo, mo is in 3)li, and if p 7^ mo, p = s(g) = g + mo = mo + g 
so that mo is in 3)12. If m is in 3)li, then s(m) = p + mo, so that 
5(m) is in 9)15. If m is in 9)12 and q = mo, then s(m) is in 9)li, but 
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if q ^ mof q - s(qi), p - m + s(qi) = s(m) + qi by (2:2) and 
s(m) is in Finally, if w is in SJJs, s(m) = s(p + = p 
+ s(n) and s(m) is in SW 3 . Thus 53)Jo C S^o and 2)?o = by 
P4. In conclusion we note that no two of the classes 9}ii, 5DJ2, SKs 
can have an element in common, by virtue of M2 and M4. 

To prove M6 we may use an indirect proof. Suppose n 9 ^ p, 
m + n m + p. By M5, we may suppose p — n + q. Then 
m + n = m + (n + q) — (m + n) + q by M2, but this con- 
tradicts M4. 

To define a relation of order in the class 3)i we choose the fol- 
lowing: 

(2:3) m < p ' = • 3q r m + q = p. 

The next four properties characterize what is called a linear order. 

M7. < is on 9K9K; that is, for every pair m and p of ele- 

ments of SJi it is determined whether m < p or not. 

M8. < is transitive; that is, m<n.w<pO'^<P* 

M9. m < m is true for no element m. * 

MIO. m?^pO*w^<pVp<m. 

In the verification of these properties it will be noted that M8 
depends on M2, M9 on M4 and M3, and MIO on M5. For a 
subclass SKo of 9K we shall use the notation p < to mean 
that p < m for every m of 2)?o. The relations >, ^ are 
defined in the customary way in terms of < and then extended 
to relations between elements and subclasses. The order just 
defined in the class of natural numbers has the following addi- 
tional property: 

Mil. 2KiC 21i*S!»i?^AO-3pin9Jli9-pg5W^^ 

An ordered class having the property Mil is said to be well- 
ordered. To prove Mil, let 9112 = [aU m g SDiJ. With the help 
of M8 and M9 it can be shown that m in O • s(m) not in 9 K 2 - 
The element mo is in 2)^2 and, if 55!Ji2 C 3)^2, we would have 
9 K 2 = by P4. Hence 3p in 9 JI 2 3* s(p) not in 2 K 2 . But p not 
in 9Ki O * P < 3)^1 0 • s(2?) ^ 3Ki. As this contradicts the 
defining property of p, we must have p in 9Jli. 

We are now in a position to make a simple proof of a general 
theorem justifying definition of functions on by recursion. 
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Theobbm 1. Let (2JJ, s) have the properties PI to P4, and let ® 
he an arbitrary class, t a function on ^ to and ka a fixed element 
of Then there is a unique function f on 'SSt to ^ such that 
fimo) = ko, andf{s{m)) = t(f(m)) for every m in 'Sft. 

Proof . — ^For convenience, let Slim = [all p ^ m\. The element 
mo is in every since if m mo, m = s(j)) = p + mo. From 
this we readily find that ? < m if and only if s{q) ^ m. We shall 
say that an element m has the property J!(/) m case /is a function 
on to ^,/(mo) = fco, and q <m- Z)-f(s{q)) = «(/(?)). Now 
let m have the property E(f), let n have the property E{g), 
and suppose m ^ n. Let Silo = [all p g m3-f{p) = g{p)] + 
CSft — 311m). Then it is easily seen that mo is in 3)io and that 
s^Sfto C SKo, so that SDlo = 311. Hence / and g are equal on Ttm- 
Now let 31li consist of all elements m for which there exists a 
function /„ with which m has the property E(,fm). It is obvious 
that mo is in 3)li. For each m in 3)ii, set/* = /^ on 311m, /*(s(m)) 
= l(/m(m)). Then s(m) has the property E{f*), so that sSlli 
C Sill, and hence 311i = 311. Since for each m, /„ is already 
known to be uniquely determined, we obtain the desired function 
/ by settmg7(m) =/m(m). 

CoEOLLABT. If h is a function on 311^ to then there is a 
unique function g on to ^ such that p(mo) = ko, and g(s(m)) 
== h(m, g(m)) for every m in 311. 

Proof. — Let 8 = 311^?, lo = (mo, ko), t{m, k) = (s(m), h{m, k)). 
Then by the theorem there is a unique function / on 311 to 8 
such that /(mo) = Zo = (mo, ko) and /(s(m)) = t(f(m)) for every 
m. Let /(m) = (/i(m), g{m)). Then ^(mo) = mo, g{mo) = ko, 
and if /i(m) = m, /(s(m)) = (s(m), h(m, g(m))), so that p(s(m)) 
= s(m), g(s(m)) = h(m, g(m)), and thus the desired result 
follows by P4. 

The next theorem justifies a property sometimes used, which 
is apparently stronger than P4. 

Theobbm 2. Let the subclass 311o of 311 contain mo, and contain 
s(m) whenever 311m C 311o. Then 311o = 311. 

Proof. — ^Let 311* = [all m a- 311m C 311o]. Then mo is in 311*, s311* 
C 311*, so that 311* = 311 by P4. But 311* C SHo C 311, so that 
311o = 311. 

We define multiplication in 311 as follows: q X mo = q,qX s(m) 
= q Xm + q. Then it is a simple matter to verify the follow- 
ing additional properties of the system (311, s, -f, X, <). 
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M12. 

X is on mm to m. 




M13. 

X is distributive with 

respect to + 

; that is, m . p . g 


O • (m + p) X O' = 

m 

Xq+pXq 


M14. 

X is commutative. 




M15. 

X is associative. 




M16. 

mXn — m'Xp^Z) 

• n 

= V- 


M17. 

m . n , p iZ) ‘ m < n 


m + p < n 

+ P- 

M18. 

m .n ,p :^:m < n 


m X p < n 

X p. 


The property M12 follows at once from Theorem 1, with 
S == SR, Ajo = g, and t(k) = fc + g, and M13 is readily proved by 
induction, using the associative and commutative law^s for +. 
We obtain M14 with the help of M13 and two applications of P4. 
Note that by virtue of the commutative law it is only necessary 
to prove the distributive law in the form stated. The property 
M15 is proved in similar fashion with the help of M13 and M14. 
An indirect proof similar to the proof of M6 suffices for M16, 
and M17 and M18 also follow easily from the definitions and the 
preceding properties. 

An an example that falls under the Corollary of Theorem 1, 
we note that g{m) = m! if ^ = 3R, Jjo = ^o, A(?n, k) = s(m) X k. 

In concluding this section we note the following result on 
isomorphism : 

Theorem 3. If (2R, s) and (9R', s') are two systems satisfying 
the postulates PI P4, then the systems (2R, s, +, X, <) and 
(9R', s', +', X', <') are simply isomorphic. Moreover, the cor- 
respondence is uniquely determined, and mo corresponds to m'^. 

This result may be verified by first proving the isomorphism 
of the simpler systems (9R, s) and (W, s') and then applying 
Theorem 1 with the definitions of +, X, <• 

3, Groups and Semigroups. — ^A group is a system (®, *) having 
the following properties: 

Gl. * is on ®@ to ®; that is, to each pair of elements a, 
6 of @ there corresponds a uniquely determined element 
a * 6 of 

G2. a .b . c (a* b) * c a* (b * c); that is, the ox)era- 
tion * is associative. 

G32. a . 6 O * 3 c 9* a * c = 5. 

G3r. a . 6 O * 3<i 9* d * a = 6. 
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We shall be interested in the two cases when the operation * is, 
respectively, addition and multiplication. For the present, the 
operation * should be thought of purely abstractly . 

Every group has also the following properties: 

G4. 3\u 9: a -Z)' = u* a = a; that is, there is a unique 

unit element?^ such that for every element am ®,a*u = 
u* a = a. 

G5. a ^'^•3\dr a* d = d^ a = u, 

G^i, a*c = a*dO‘C = d. 

G6r. c*a — d*a-'2)'C=^d. 

It is easily seen that the properties Gl, G2, G4, and G5 imply G3, 
so that they might be used as an alternative definition of a group. 
A system having properties Gl, G2, and G6 is called a semigroup. 
A group or semigroup having also the following property G7 is 
called commutative or Abelian. 

G7. = 5* a. 

It is evident from the properties Ml, M2, M3, and M6 of 
Sec. 2 that the system (SK, +) forms a commutative semigroup. 
The system (SOI, X) also forms a commutative semigroup. 

Exercise 

Let ®i = [all positive even integers], 

®2 = [all positive odd integers], 

®3 = [all positive and negative even integers and zero], 

@4 = [all positive and negative odd integers]. 

Determine which of these classes, with the operation of addition 
or with the operation of multiplication, forms a group or a 
semigroup. 

4. The Embedding of a Semigroup in a Group. — A funda- 
mental process is that of enlarging a commutative semigroup so 
as to obtain a group. We assume that (®, *) is a system having 
the properties Gl, G2, G6, and G7. First consider the class ^ 
of all pairs (a, a') of elements of ®. 

We introduce an equivalence relation =o= in the class §, defined 
by the formula (a, a') ^ (b, b') • = • a*b' ^ a' ^ 6. By means 
of the properties Gl, G2, G6, and G7 it is easy to verify that the 
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relation =c= is reflexive, i,e., always (a, a') =c= (a, a'); symmetric, 
i.e.j (a, a') (6, 6') O * (&, ?>') — (a, a') ; and transitive, i.e., 

(a, a') {h, &') . (6, &') o (c, o') O * («, a') =s= (c, c'). It is only 

by virtue of having these three properties that the relation =c= is 
properly called an “equivalence relation/’ This equivalence 
relation divides the class ^ into mutually exclusive subclasses, 
for which we use the notation {a, a'}. The symbol {a, a^} 
stands for the class of all pairs (6, V) which are equivalent to 
(a, a'). We denote the class of all {a, a'} by the symbol 3?- 
This process of obtaining a class 3 from a class § by means of 
an equivalence relation is sometimes called identification. We 
define an operation * in the class 3 as follows: {a, a'} * {&, V} 
= {a * 6, a' * &'} . In order to show that this operation has the 
property Gl, we need only verify that (a, a') = 0 = (c, c') . (6, &') 
=c= (d, .d') O * of * V) ^ {c*dj c' * d'). Properties G2 

and G7 (the associative and commutative laws) are obvious. 
To verify property G3 we note that when {a, a'} and {b, V} are 
given, {a, a'} * {a' * &, a * ¥} = {b, 6'}. Thus we have proved 
that the system (S', *) constitutes a commutative group. 

The system (S, *) is an enlargement of the system (®, *) 
in the sense that it contains a subsystem (Sg, *) which is simply 
isomorphic to (®, *). To each element a of ® corresponds the 
element {a*bj b} of S, and the correspondence so set up is 
one-to-one by G6 and G7. It is also easy to verify that a* c 
corresponds to {a *bjb] * {c * 6, 6}, and that each class {a *bj b} 
consists only of pairs of the form (a * d, d). The following 
theorem shows that the extension (3?, *) of the system (®, *) 
which has been obtained' is, in the appropriate sense, the mini- 
mum extension that forms a group. 

Theorem 4. Let (®, *) be a commutative semigroup, (8, *) a 
commutative group, and (8g, ?*) o subsystem of (8, *) which is 
simply isomorphic to (@, *). Then there is a subsystem (8j, *) 
of (8, *) which contains (8g, *) o>nd is simply isomorphic to the 
extension (S', *) of (®, *) to form a group. 

To prove this,' let the elements of 8 be denoted by capital 
letters, and let A, A', B, and B' be the elements of 8 g correspond- 
ing to a, of, h, and b', respectively. To each element {a, a'} 
of S corresponds a unique element C of 8 by means of the equation 
A — A' *C, since a * &' = a' * 6 implies that A * B' - A' * B, 
A^ *C * B^ — A' * B, and finally C * B' ^ B. The class 8j 
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consists of all the elements C obtained in this way. It is easily 
verified that two distinct elements {a, a'} and {&, 6'} of 3 cannot 
correspond to the same element C of Sj and that the correspond- 
ence is preserved under the operation *. Finally, {a * b] 
corresponds to -4, so that 2g C 8j. 

6. The Positive Rational Numbers. — The second step in the 
historical development of the concept of number was the intro- 
duction of fractions. In this section we consider a logical basis 
for this step. The starting point is the algebraic system (501, s, 
-b, X, <) of the natural numbers, having the properties PI 
to P4 and Ml to M18. We now apply the process of Sec. 4 
to the semigroup (50f, X) to form a group (S, X), whose elements 
/ have the form {m, m'}. Thus each fraction / consists of a class 
of pairs of natural numbers. 

The next step is to define the operation of addition for the 
system of fractions. As is customary in algebra, the symbol 
X for multiplication is omitted here and in the sequel where no 
ambiguity can arise. It is easily verified that if (m, m') =o {n, n') 
and (p, p') (g, o'), then (mp' + m^Pj rn/p^) o (ng' + n'q, 

n'q'). From this it follows that, if / == {m, m'}, g = {?>? p'}, the 
definition 


f + g = {mp' + m'p, m'p'} 

yields an operation of addition with the property Ml, that is, 
4- is a function on §5? to JJ. 

The system (g, -f, X) has the following properties: 

FI* (Sj +) forms a commutative semigroup. 

F2. (5, X) forms a commutative group. 

F3. X is distributive with respect to +. 

F4. f9^g-'^-3h9-f~g + hVf + h — g. 

F5. There is a unique subset of g such that the system 
(Sm, +, X) is simply isomorphic with the system (5IR, 
+, X) of Sec. 2. Moreover, the correspondence between 
5!)i and is uniquely determined. The units for multi- 
plication in the two systems must correspond. 

F6. / in g O * 3g in gn. in fg = h. 

To prove property F4, let / = {m, m'}, g = [n, n'}. Then 
mn' 9 ^ m'n. By M5, we may suppose for definiteness that 
mn' + p = m'n, where p is properly chosen. It follows that 
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[m, mf] + {Vj w^'n'} = {n, n'}. The subset in F5 consists 
of those elements/^ of the form {m, mo} . It is \vorth remarking 
that the property F5 follows logically from the properties FI to 
F3 without reference to the definition of the elements of the class 
g, provided we assume that g has at least two members. To 
show this, we define to be the logical product of all the sub- 
classes ^0 of having the property that go contains the unit 
for multiplication, which we denote by the usual notation 1, and 
contains / + 1 whenever it contains /. To prove F6, we note 
that if f = {m, m'}, we may take g = {m', mo}, h = {m, mo}. 

We say that f < g m case 3h 9^ f + h = g. This is formally 
the same as the corresponding definition for order in the class 
If / = {m, m'}, g = {n, n'}, f < g mn' < m'n. The follow- 
ing additional properties are logical consequences of FI to F6 
and this definition of order. 


F7. 

(g, 

<) forms a linearly ordered set. 

F8. 

f -9 

.h:Z)‘-f <9 +h <g + 

F9. 

f-9 

.h:^:f<g -^-fh < gh. 

FIO. 

f< 

g ■'2>-3h9-f <h < g. 

Fll. 

f -9 

0*3Ain ^ms-/ < gh. 


To verify F7, we have to show that the properties M7 to MIO 
of Sec. 2 hold for the system (g, <). M7 and M8 are immedi- 
ate, and MIO follows from F4. If / and h are such that 

(5:1) / + 

then f + g + h^f + g ion every fraction g, and g + h — g hy 
the uniqueness of subtraction (FI and G6). If we multiply 
(5:1) by h~'^g, we have fh^^g + g = fh'~^gj and hence h + g = h 
= gj and the class g reduces to the single element A. But this 
is impossible by F5. This proves that / < / cannot occur. 

Property FIO expresses the fact that the class g is dense with 
respect to the relation < . To prove it, let f + e = g, e ^ 2a, 
where 2 == 1 + 1. Then f <f + a <f + 2a = g. Property 
Fll is usually called the Archimedean property. It is easily 
derived from F6 for, if / 2 f = fi, g^g = g^ where /i, / 2 , gi] g^ are in 
gM, we may take h = g 2 fi + gz- 

6. Linearly Ordered Sets, — linearly ordered set is a system 
(12, <) with the properties: 
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01. < is a relation on I2Q. 

02. < is transitive. 

03. » < j; is true for no element v of Q. 

04. V ■^W'Z>“o <w\/ w <v. 

These properties are identical with the properties M7 to MlO 
of Sec. 2. For convenience we shall as usual use the symbol 
w > to mean the same thing asv < w. The relation > is dual 
to the relation < . The system (Q, < ) is said to be dense in case 
it has the additional property 

05. V < w V < X <w. 

An element a; of Q is a lower bound of a subclass ft of Q in 
case a: g t) for every a in it. For this relationship we use the 
notation x ^ K. The definition of an upper bound is dual, that 
is, has < replaced by >. We shall denote by Ki the class of all 
lower bounds of it, and by the class of all upper botmds. 
These classes may of course be null. If the class itj has an upper 
bound y contained in it;, then y is called the greatest lower bound 
of K and is denoted by the symbol “g.l.b. it”. From the prop- 
erties 01 to 03 of a linearly ordered set, it follows readily that a 
set K cannot have more than one greatest lower bound. The 
definition of the least upper bound of it, denoted by the symbol 
“l.u.b. it,” is dual to that of the greatest lower bound. A linearly 
ordered set Q is said to have the Dedekind property, or to be 
complete, in case every subset K which has a lower bound has a 
greatest lower bound in Q. We see at once that a linearly 
ordered set Q is complete if and only if every subset K which has 
an upper boimd has a least upper boimd in Q. 

7. Dedekind Cuts.— The system (2)i, <) of the natural num- 
bers forms a complete linearly ordered set, but it is not dense. On 
the other hand the system <) of fractions is not complete, 
although it is dense. It is the purpose of this section to show 
how to obtain a complete system from a given dense linearly 
ordered system Q, by making use of the “Dedekmd cuts” in 0. 

A subset A of Q is said to determine a Dedekmd cut in Q in 
case it has the properties: 


Dl. A 5^ 0. 
D2. A a 
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D3. a in A ,ai < a O * in 

D4. If l.u.b. A exists, it is not in.. A. 

The condition D4 is equivalent to the following: a in ^ O * 
in Ar ai> a. The set complementary to A will be denoted by 
cA, and the partition of 0 into the two classes A and cA is the 
Dedekind cut determined by A. For example, a Dedekind cut 
in the system g of positive fractions is determined by the set 
A = [all a < 3], and another cut is determined by the set 
B = [aU < 3]. It is slightly more convenient to work with 
only one of the classes A and cA making up a Dedekind cut. 
Consequently in the sequel we shall refer to the classes A having 
the properties D1 to D4 as the Dedekind cuts in 0. 

The class of all cuts in 0 wall be denoted by F. The relation < 
is defined for the class F by saying that A < B in case 
A C B, that is, A is a subset of B but B is not a subset of A. 

When (S2, <) is a linearly ordered set, it is easy to show that the 
system (F, <) constitutes a complete linearly ordered set 
(unless it is vacuous) and that it is nonvacuous and dense when 
0 is dense. For example, if L = [A J is a set of cuts having an 
upper bound, the least upper bound of L is the logical sum of the 
classes Aa, 

l.u.b. L = '^A„. 

The greatest lower bound is not always given directly by the 
logical product, on account of the requirement D4. Moreover, 
it is clear that when 0 itself has no lower bound and is dense, 
the system (F, <) contains a subsystem (Fe, <) which is simply 
isomorphic with (0, <). The elements of Fq are those cuts A 
for which l.u.b. A exists in Q. 

When the set 12 is not dense, it is necessary to omit the property 
D4 in order that each element of 12 may determine a cut. The 
properties D1 and D2 may also be omitted when there is no 
question of defining addition and multiplication. Since in Sec. 8 
we wish to consider the cuts in the dense system (g, <), which 
has no lower boimd and no upper bound, and to define addition 
and multiplication for them, it is desirable here to assiune all 
the properties D1 to D4. 

8* Construction of the Real Number System. — ^We shall denote 
the complete dense linearly ordered set composed of the cuts 
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in the system (5, <) by O. When we have defined the opera- 
tions of addition and multiplication inO, we shall have obtained 
the system of positive real numbers. Let A and B be two cuts 
in g, that is, A and B are two subclasses of ^ having the proper- 
ties D1 to D4 of Sec. 7. Then A + £ is defined to be the class C 
of aU fractions c of the form a + &, where a ranges over A and b 
ranges over B. Likewise AB is defined to be the class D of all 
fractions d of the form ab. Note that here we are not using 
A + B and AB to denote the logical sum and product of classes. 
It is now possible to verify that the system (O, +, X, <) has 
the following properties. All but the last of these are extensions 
of corresponding properties of the system (g, +, X, <)• 

Ql. The setO contains at least two elements. 

Q2. (O, +) is a commutative semigroup. 

Q3. (O, X) is a commutative group. 

Q4. X is distributive with respect to +. 

. Q5. (£i, <) forms a linearly ordered set. 

Q6. A <B 3Cr A + C ^B. 

Q7. (Q, <) has the Dedekind property. 

To prove these properties we need the following lemma, which 
follows by an indirect proof from the Archimedean property Fll. 

Lemma. For every fraction e and every cut A there is a fraction a 
in A such that a e is not in A. 

In verifying that the classes A + B and AB are cuts, we find 
that the properties Dl, D2, and D4 are fairly obvious in both 
cases. For D3, we note that if ci < a + 6 then Ci = ai H- 
where ai = aci/{a -|- 6) < a, = bci/{a + b) <b. Also if 
dl < abj then di = ai6i, where ai = di/b < a, &i = 6. The com- 
mutative and associative laws are obvious. To verify the unique- 
ness of subtraction, let A + = A -f C, and suppose that the 

class S is a proper subset of C. If ci and C 2 are in C — £ and 
Cl < C 2 , there is by the lemma an element ai of A such that 
ai + (c 2 — Cl) is not in A. Then for every a in A and 6 in 5, 
^ (^1 + C 2 ~ Cl) -[- Cl = ai -h C 2 , so that the number 

dl + C 2 is not in A + 5. This contradiction shows that B can- 
not be a proper subset of (7, and likewise C cannot be a proper 
subset of B, so that B - C. 

To show that division is always possible is slightly more 
troublesome. For given cuts A and C, we shall show that the 
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class B of all fractions c/a' where c is in C and a' is not in A is a 
cut satisfying the equation AB = C. It is plain that B has the 
properties D 1 to D 4 . The product AB by definition consists, 
of all fractions acid ^ where a is in - 4 , c is in C, and a' is not in A, 
Thus a < a' and ac/a' < c, so that AB C. C. Now let c be an 
arbitrary fraction in C. Choose aim A, and Ci > c and in C, 
and set e = ai(ci — c)/c. By the lemma there is a fraction 
a > ai and in A such that a + e is not in A. The fraction 
C2 = aci/ {a + e) is obviously in 4 .B. Thus 

caci = cc^a - 1 - cc^c = cc2a + C2ai(ci — c) < cc2a + C2a(ci — c) 

= C2aci, 

and hence c < C2 and C C AB. 

To prove the distributive law we note first that the class 
{A + B)C C AC + BCy since the first class consists of all frac- 
tions of the foim ac + &c, while the second consists of all frac- 
tions of the form aci + hc%. If Ci < C2, ai = aci/c^ < a, and 
so ai is in 41 . Hence aci + — aiCt -f hc^, which is a member 

of {A + B)C. 

For property Q6, we define the class C to be the class of all 
fractions of the form 6 — a', where a' <b and a' and 6 are in B 
but not in 4 L. It is easily seen that C determines a cut and that 
A + C ^ B. To prove B ^ A + Cj 'we note first that, if 6 is 
in A, we may choose 6i and 62 in B but not in 4 L so that 61 < 62 
and 62 ” 61 < bj and then set a = 6 — (62 — 61). If 6 is in 
B but not in A, there is a fraction bi> b and in B, and by the 
lemma there is a fraction a in 4 L such that a' = a + &i & is 
not in A. But a' < bi, so a' is in B, and a + 61 a' = 6. 
To prove the converse we note that for every cia C there exists 
by the lemma a fraction a in 4 . such that a -f c is not in A, 
although it must be in B. Hence A < B. 

As the final step in the construction of the real number system, 
we extend the semigroup (O, +) to form a group (% +), accord- 
ing to the process outlined in Sec. 4 , and then define the operation 
of multiplication and the order relation in SR as follows. Let the 
elements of SR, which are classes of equivalent pairs of cuts, be 
denoted by Greek letters, and let a = { 4 , 4 '}, jd = {B, B'}, and 
so on. Then by definition ap = {AB + 4 'B', 4 B' + 4 'B}, 
and a < p in case 3 ( 4 , 4 ') in a. 3 (B, B') in^r A + B^ < A' 
+ B. It will be necessary of course to verify that the operation 
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of multiplication is a single-valued function of the two factors, as 
stated in property R3 of Sec. 9. 

Let us note that, if A = A' + C, and the pairs (A, A') and 
{B, B') are both members of the same real number a, then 
B ^ B' + C, and conversely. This shows that there is a one- 
to-one correspondence between the numbers C and the numbers 
a = {A, A'} for which A > A'. We shall indicate this corre- 
spondence symbolically by o: = C. In the same way there is a 
one-to-one correspondence between the numbers C and the 
numbers a = {A, A'} for which A < A', which we shall indicate 
by a ^ — C. In case A = A\ we shall write a ^ 0. This is 
obviously the identity element for addition. We verify at once 
that 

a^C. 

a ^ C. iS ^ ~D O * a/S ^ -CD, 

(8:1) -C. /3^DO-o:/3^ -CD, 

a ^ -C, -D^O' a^^CD, 

a^0V/3^0O*^^/5 = 0. 

These statements show that the operation of multiplication in 9i 
is well-defined. They also show that we could have made the 
extension of the system (O, +, X) simply by introducing the 
artificial element 0 and the '‘tagged’^ elements —(7. The 
formulas (8:1) would then become the definition of multiplication 
in the extended system. In the following proofs it is convenient 
to make use of both points of view. 

For convenience a set of properties characterizing the real 
number system is collected in Sec. 9. It is easy to verify that 
the system we have been constructing has these properties. The 
property R2 follows at once from the general theory of Sec. 4. 
The first part of 113 has already been verified, and the associative, 
commutative, and distributive laws follow immediately from the 
original definitions of + and X. To verify 114 we recall that 
for arbitrary numbers A and C there is always a number B 
such that AJ? - C. Then for arbitrary numbers a and y, with 
a 0, we have the following solutions of the equation ap = y 
in the six cases: 


1 . a^A,y^0,p^0. 

2 . a^A,y^C,p^B, 
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3. 7^ -C, “5. 

4. a ^ -A, 7 ^ 0, /3 ^ 0. 

5. a ^ -A, -B. 

6. -A,y ^ -C, p 

The properties E5 and R6 are readily verified using the original 
definitions of + and <. We note also that a > 0 if and only 
if there is a number C in £l such that a = C, and that a < 0 if 
and only if there is a C such that —C, Moreover, if a ^ (7, 
/? = D, then a < 13 C < D, and if a ^ — C, S = — D, then 
a < ^ D < C. The property R7 is now obvious, and we 
verify R8 as follows. If iT is a subset of and 0 ^ K, but 
0 7*^ gd.b. K, then 37 > 0 7 ^ iT. Hence g.l.b. K exists by the 

Dedekind property of O. On the other hand, if 7 g if, and 
3 q: < 0 in iT, let Ki consist of all elements C = —a where a < 0 
and q: is in jKT. Then Cq ^ where Co = —7, and 3Ci = l.u.b. 
Ki by the Dedekind property of O. Hence —Ci ^ g.l.b. iT. 

9. Properties Characterizing the Real Number System. — The 
real number system (9t, +, X, <) is characterized by the follow- 
ing properties: 

Rl. The class 3i contains at least two elements. 

R2. (JR, +) is a commutative group. 

R3. X is on to 9?, and is associative and commutative, 
and distributive with respect to +. 

R4. The class 9t with the unit 0 for addition omitted, and X, 
forms a group. 

R5. (9?, <) forms a linearly ordered set. 

R6 . c»:</?.70*<^ + 7 <i^ + 7- 

R7. a>0,/3>0‘^'aj3>0. 

R8. (91, <) has the Dedekind property. 

A system having the properties Rl to R4 is called a field, and 
a system having the properties Rl to R7 is called an ordered 
field. (See, for example, Albert, Modern Higher Algebra^ pages 
27, 110.) The only ordered field with the Dedekind property 
is the real number system, in the sense that two systems having 
the properties Rl to R8 are necessarily simply isomorphic. 

The real number system has the following additional proper- 
ties, which are logically deducible from Rl to R8 without refer- 
ence to the method of constructing the real numbers. The 
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usual notation 1 is used for the unit element for multiplication, 
and we omit the sign X according to custom. Furthermore, we 
set laj = a if a ^ 0, \a\ = —a if a < 0. 

R9. a.^O-a'X0 = 0.a(-iS) = -(a/3) = 

(-a)(-iS) = a^. 

RIO. 0 < 1. 

Rll. o:>0./3<7O*aiS< ay, 

R12. There is a subset SIm of such that the system +, 
X, <) is simply isomorphic to the system (SO?, +, X, <) 
of Sec. 2, Every element m of 0tM satisfies ju > 0. and 
1 is the first element of SRm- 

R13. a > 0 . jS > 0 O • 3/x in 9 ?m Ma > jS. 

R14. a < /3 O * 3 m in SRm* 3p in SRm a < < /5 V 

a < —il/v < / 3 . 

R15. a . ^ O ’ |a + ^1 ^ N + 1^1 . \aP\ = lajl^l. 

To prove R9, we see that, by the distributive law, a = a X 1 
— 01(1+ 0) ==a:Xl+aX0 = a + <a:X0, so that a X 0 = 0. 
Next, a(— jS) + QfjS = a(— jS + jS) = a X 0 = 0, SO that a(—p) 
= -(ajS). Finally, (-a)(“/3) + (-a/S) = (--a)(~^) + (-a)^ 
= + 0) = {-ol) X 0 = 0, so that {-a){—0) = a0. 

To prove RIO, we note that, if 1 = 0, then a = a X 1 = 
a X 0 = 0 for every a, and this contradicts Rl. Hence 1 < 0 

V 1 > 0 by R5. If 1 < 0, then 0 = 1 + (~1) < —I by R6, 

and thus 1 = (— 1)(— 1) > 0 by R7. The property Rll follows 
readily from R6 and R7. 

To prove R12, let us say that a subclass Ofo of 3i has the prop- 
erty (H) in case 9?o contains 1, and contains a + 1 whenever it 
contains a. The subset 9 ?m is defined as the logical product of 
all subclasses 9?o having the property (H). Thus 9 ?m is the 
minimum subclass of SR having the property (H). If we let 
SRi = [all a in SRm 9* a > 0], we see at once that SRi has the 
property (H), by RIO and R6, so that SRi = SRm. Setting 
s(oi) == a + 1, we see at once that the system (SRm, s) has the 
properties PI to P4 of Sec. 2, with mo = 1. The operations of 
addition and multiplication defined in that section in terms of the 
function s are seen to coincide with the addition and multiplica- 
tion of the real number system by virtue of the associative and 
commutative laws for addition, and the distributive law. 

To prove the Archimedean property R13, we use an indirect 
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proof. Suppose every n in. dtu satisfies n ^ p/a. Then 3r 
= Lu.b. SiM, by E8, and Hjit in 9* m > t — 1. Then y < p + 1 
by R6, and this contradicts the definition of y. 

The density property R14 can be proved by means of the 
Archimedean property. Suppose first 0 ^ a < p. Then by 
R13, 3v in SJm v{P — a) > 2, and 3ju in 9 ?m (m — 1)A = « 
< ii/v, since every nonnull subset of has a first element, by 
property Mil of Sec. 2. From this, }i/v ^ a 1/v < a 
+ {P — a)/2 < p. Next suppose a < 0. Then from R6, RIO, 
and R13, 3(r in 9-0<cr + a<(T+p. By the first case, 
3/x .3v <T a < ii/v < <r -j- jS, so that a < {ii — <rv)/v <. phj 
R6. If it should happen that fi — cv = 0, then bv the first case, 
3 m'. 3/ 9-0 <m'A' </3. 

It is easy to show that an isomorphism between two systems 
(3ii, +, X, <) and (9t2, +, X, <) having the properties R1 to 
R8 can be set up in one and only one way. In the first place it 
is clear that the units for addition in the two systems must 
correspond, and likewise the units for multiplication. Conse- 
quently the correspondence of the subsets "Sim and ^ 2 u described 
in R12 is determined. If we let 9 Jif and SK 2 F denote the sets of 
positive rational numbers in the two systems, we see that the 
correspondence between 9tip and 9?2 f is likewise determined. Let 
elements of 9? rp be denoted by ai and let elements of 9t2F be denoted 
by a 2 . For a given ai > 0 in 9ii, let Ki = [all ai > aj. Note 
that Ki is a subset of 9iiF. Then by R14, ai = g.l.b. Ki. Let 
K 2 be the subset of 9 i 2 P consisting of all the elements ^2 corre- 
sponding to elements ai of Ki, and let 0:2 = g.l.b. K 2 correspond 
to ai. It is not difficult to verify that this correspondence is 
preserved under addition and multiplication. Obviously no 
other way of setting up the correspondence would preserve the 
order relation. Finally, the correspondence is set up for the 
negative real numbers in the obvious way. This process of 
establishing the isomorphism between two systems satisfying 
the postulates R1 to R8 follows in outline the process we have 
selected for constructing the real number system. 

10. Additional Properties of the Real Number System. — In 
this section we shall use a variety of letters to stand for numbers 
and disregard the connotations in use in the preceding sections. 
The numbers considered are supposed to lie in an ordered field, 
i.e.j in a system (8i, +, X, <) having the properties R1 to R7. 
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A sequence (a„) in [R is a function that makes correspond to 
each positive integer n a uniquely determined number a„ in 
The notion of limit of a sequence is defined as follows: 

lim 1 := • € > 0 : 3) ; 3nt s: n > rie O • ~ < «• 

The agnificance of this definition is indicated graphically in the 
figure, where n is plotted along the a>-axis, and o„ along the y-axis. 
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The graph of the function consists of isolated points. All the 
points of the graph to the right of the line a: = n. are supposed to 
lie between the lines y = I e and y = I — A sequence (a«) 
is a Cauchy sequence, or satisfies the Cauchy condition, in case 

e > 0 : 3ra, 9 : m > n. . n > n. O • [om - fl/.! < 6. 

Theobem 5. Every Cauchy sequence is hounded. 

Theoeem 6 . Ev&Tj sequence hewing a limit in 'iSt is a Cauchy 
sequence. 

Theorem 7. // the ordered field 31 hns the Dedekind property 
eoery Cauchy sequence (on) in dt has a limit in 91 . 

Proof. By Theorem 5, (a„) is bounded, so that we may set 
b, = l.u.b. 0 ,, for m > n, and 1 = g.l.b. 1 >„. Then 3? 9 - h, g 1 + 
Ut p be an mteger greater than q and greater than the n, of 
the Cauchy condition. Then w > p O ’ a, g 6 , g 1 + e. Also 
3m > p 5 - (V > e ^ by the Cauchy condition 

^ P D — 2 €, and finally we have [ob ~ l\ 

A Cauchy sequence is sometimes called a regular sequence 
3 r a convergent sequence. The term convergent sequence is 
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sometimes also used to mean one that has a limit. According 
to the last two theorems the two usages are equivalent m the real 
number system. However, when the numbers used are restricted 
to be rational, a Cauchy sequence need not have a limit. 

A sequence (a-^) is said to be nondecreasing in case n < m 
O * It is said to be nonincreasmg in case n < m 

0 * ^ A monotonic sequence is one which is either 

nondecreasing or nonincreasing. 

Theorem 8. If the ordered field 91 is ArchimedeaUj eioery mono-- 
tonic hounded sequence is a Cauchy sequence. 

This may be proved by an indirect proof. 

Theroem 9. If the ordered held 9? has the property that eoery 
nondecreasing hounded sequence has a limit, then 9i has the Dede- 
kind property. 

Proof, — ^We first show by an indirect proof that the field is 
Archimedean. Suppose there exist positive numbers a and h of 
the field such that na ^ 6 for everyintegern. Then the sequence 
(na) is mcreasing and bounded, and so has a limit I, By def- 
inition of limit, I — na < a for n sufficiently large, so that 

1 < {n + l)a. But it is easily seen that I'^na for every n, so 
that we have arrived at a contradiction. 

Now let X be a set of numbers which is bounded above. Let 
a be a number in K, let h ^ K, and let Ci = (a + 6)/2. If 
K g Cl, set ai = a, hi = ci, otherwise set ai = Ci, hi = h. This 
indicates how to define recursively two sequences (a„) and (bn)- 
If a«-i and hn-^i have been defined, set Cn = (on-i + &n~i)/2. If 

K Oji, set Un On—lj hn OtherWlSe set an — any hn hn-l- 

It is clear that the sequence (an) is nondecreasing and bounded, so 
that by hypothesis it has a limit I, Since bn ^ an — (h — a)/ 2 ®, 
it is easy to see by the Archimedean property that lim (hn — an) 
= 0, and hence I -]imhn- Also K ^hn for every n, and so 
K ^ I, We note also that if Z 5 ^ Lu.b. K,3€ > Or K S I — 
and from this, 3n r K < any but this contradicts the definition 
of any so that we must have Z = Lu.b. K, 

The last two theorems show that, if an ordered field is Archi- 
medean and has the property that every Cauchy sequence has 
a limit in the field, then the field is complete, i,e,, has the Dede- 
kind property. Thus there are three possible ways of formulat- 
ing the concept of completeness for ordered fields, each of which 
has its advantages. It is worth remarking that the notions of 
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limit and of Cauchy sequence may be used in situations where the 
relation of order and the operations of addition and multiplica- 
tion are not defined. 

Two sequences (an) and (bn) are said to be equivalent in case 
lim (an — bn) = 0. This relation is easily seen to be reflexive, 
symmetric, and transitive, so that it may be used to divide the 
class of all sequences into mutually exclusive subclasses. By 
restricting attention to Cauchy sequences of rational numbers, 
we may introduce the construction of the real number system 
due to Cantor. According to Cantor, a real number is defined 
to be a maximal class of equivalent Cauchy sequences of rational 
numbers. It is easy to define addition, multiplication, and an 
order relation for such classes, and the system so set up may be 
shown to have the properties listed in Sec. 9. The correspond- 
ence between Cauchy sequences of rational numbers and the 
Dedekind cuts in the rational number system may be defined 
directly. 

A sequence (cn) is a decimal sequence in case ai is an integer 
(positive or negative), and = an + hw/10”, where bn is one 
of the numbers 0, 1, 2, . . . , 9. It is clear that every decimal 
sequence is bounded and nondecreasing and so has a limit in the 
real number system. A decimal sequence is normal in case 
& O * > ft 9- 6n 7 *^ 9. By means of the Archimedean property 

it may be proved that every real number is the limit of exactly 
one normal decimal sequence. Thus we see that the real num- 
bers might have been defined as the normal decimal sequences. 
Of course other bases than ten might have been used for a system 
of numeration. In particular the bases two and three are some- 
times useful in discussing the properties of certain point sets. 

A class is said to be denumerable in case it can.be set into one-to- 
one correspondence with the class of natural numbers. A class K 
is said to be finite in case there exists a natural number m such 
that K can be set into one-to-one correspondence with the 
set of all natural numbers not greater than m, and K is then 
said to have m elements. It is important to note that the 
class of all rational numbers is denumerable, while the class 
of aU real numbers is not. Since the class of even integers 
is denumerable, it suflBices for the first statement to show that 
the class of positive rational numbers is denumerable. We 
can, for example, make each positive fraction p/q correspond to 



Sec. 10] 


ADDITIONAL PROPERTIES 


39 


the integer n = (?? + ^ — l)/2 + p. This makes infin- 

itely many integers correspond to each positive fraction. By 
dropping out all but the first one in each case (obtained by repre- 
senting the fraction in its lowest terms), we establish a one-to-one 
correspondence of the class of positive rational numbers with a 
subclass of the integers. It is easy to see then that the class of 
positive rational numbers is denumerable. 

To show that the class of all real numbers is not denumerable, 
we suppose that (c^) is a sequence containing all the real numbers 
and consider the normal decimal representation of each number 
Cn. We may readily define a normal decimal sequence whose 
digit in the nth decimal place differs from the corresponding 
digit of Cn, and thus determine a real number c which does not 
occur in the sequence (O. 
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CHAPTER III 
POINT SETS 

1. Space of 'k Dimensions. — k point in one-dimensional space 
is a real number or one of the ideal elements + . These 

two ideal elements + oo and — oo are introduced for convenience 
in connection with the theory of limits. We define an order 
relation between them and the real numbers by saying that for 
every real number 6, — oo There is not a great 

deal of use for a definition of the operations of algebra on these 
ideal elements, but they can easily be defined in a way that is 
consistent with the theory of limits except for those forms like 
0* 00 which are commonly called ^'indeterminate^' forms. 

By the Cartesian product of two classes P and Q is meant the 
class of all couples (p, g), of which the first element p is chosen 
from P and the second element q from Q. The Cartesian product 
of one-dimensional space by itself gives us a two-dimensional 
space, frequently called the number plane. By properly chosen 
definitions we obtain from the number plane an ordinary Euclid- 
ean plane plus four lines at infinity. The number plane 
corresponds to a coordinate system set up in the Euclidean plane. 
The four lines at infinity ia the number plane are defined in terms 
of a: 2 /-coordinates by the equations x = -l-oo,a; = — oo,^ = -f-oo, 
y — — CO. By forming the Cartesian product of k classes each 
composed of the real numbers and the ideal elements + and 
— 00 , we obtain the A;-dimensional number space of points 
• • • , each of whose coordinates is either a real 
number or oo or — oo . When it is not necessary to indicate 
the number of dimensions or to consider the individual coordi- 
nates, we shall use the abbreviated notation x for the point 
{x^^\ . . . , The definitions and theorems given in this 

chapter are equally valid for any finite number of dimensions. 
For explicitness and simplicity most of the examples are given in 
spaces of one and two dimensions. 

The geometric language is used because of its convenience and 
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suggestiveness. Much of this chapter is devoted to introducing 
the terminology of point-set theory and clarifying its meaning 
by means of examples. We recall that the terms class/’ '^fam- 
ily/’ and ^‘aggregate” are used as synonyms for the term '^set.” 
In connection with point sets in a number space, the term 
‘‘region” will be used as stiU another synonym. 

2. Examples of Point Sets. — The first examples, A to F, are 
in one-dimensional space. The notation E^l ] or E[ ] will 
be used to denote the set of all points satisfying the condition 
written in the bracket. Occasionally the notation S[ ] is used 
to denote the subset of a given point set S which satisfies the 
condition written in the bracket. 

A. An open interval (a, b) consists of all points x such that 
a < X <bj where a and b are fixed points, i.e., (a, b) 
= Ex[a < X <b]. 

B. A closed interval [a, b] = FJa ^ x ^ b], 

C. The set of points with positive integral coordinates. 

D. The set of points whose coordinates are the reciprocals of 
the positive integers. 

E. The set of all points with rational coordinates. 

F. The Cantor discontinuum. This is formed from a closed 
interval [a, 6] by removing first the middle third, then the 
middle thirds of the remaining intervals, and so on indefi- 
nitely. It is understood that the intervals removed are 
open intervals. The set of points remaining after the 
infinite sequence of operations just described is called the 
“Cantor discontinuum.” Its properties will be discussed 
in more detail in Sec. 4. Its construction may be varied 
by replacing the fraction i by some other fraction. 

The following examples G to K are in two-dimensional space: 

G. An open interval (a,c; b,d) = E^ula < x < h; c < y < d\. 

H. A closed interval [a,c; bjd] — Exy[a ^ x ^ b; c ^ y ^ dl. 

I. The set of all points on the circumferences of the circles 

with centers at (1/2”, 0) and radii respectively for 

n = 1, 2, . . . . 

J. The set of all points interior to the circles described in I, 

K. The set of points (— oo, n), where n = 1, 2, . . . . 

L. The set Exy[- ^ <x<+^;x^^y^ 2x^]. 
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M. The set composed of the points for which 0 < a; ^ 1, 
y = sin {l/x)i plus the interval — 1 ^ t/ S 1 of the 
2/-axis. 

3. Operations on Aggregates. — ^Various operations on point 
sets will be discussed in this section. These operations are 
obviously applicable to aggregates of any nature whatever, as 
was indicated in Sec. 3 of Chap. I. 

The sum of two sets A and B, denoted by the symbol A + B, 
consists of all points x that belong to at least one of the sets 
A and B. The product or intersection, denoted by AB^ con- 
sists of all points x that belong to both sets A and B, These 
definitions are obviously extensible at once to collections of any 
number (finite or infinite) of sets Aa- For such sums and 

products we may use the ordinary abbreviated notations ^Aa 

and YIAccj respectively. Since there may not be any points 
belonging to both of two arbitrary classes A and it is con- 
venient to speak of the null class, which has no elements what- 
ever, and for which one of the notations A or 0 is frequently used. 
Thus, using the examples I and J, we may write 

IJ = A or IJ = 0. 

Two sets whose intersection is the null set are said to be disjoint. 

The difference of two sets, written A — JS, consists of all 
points a; in A but not in B. Obviously the difference of two sets 
may also reduce to the null set. A special case of a difference 
is the complement of a set A, frequently written cA, which con- 
sists of all points x of space not in the set A. It is worth while 
to note that the complement of a product of sets is the sum of the 
complements of the respective sets and, vice versa, the comple- 
ment of a sum is the product of the complements. Thus AJ5 
= c{cA + cJS). Also A — jB = AcB — c(cA + J5). Thus the 
two operations of taking sums and complements may be taken 
as fundamental if this is desired. Referring to the examples C, 
D, and E, we note that (C + D) — E C + (D — E). 

Associated with each sequence of sets A» are two limiting sets, 
frequently called the limit inferior (or the restricted limit) and 
the limit superior (or the complete limit) of the sequence, which 
may be defined by the respective formulas 
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lim inf A„ = ^ n A„, litn sup il„ = fj ^ 

m n>m m n>m 

The limit inferior contains all those points which belong to all 
the sets An from a certain place on. The limit superior consists 
of all those points which belong to infinitely many of the sets An. 
In case the limit inferior and the limit superior turn out to be the 
same set, this set is called the limit of the sequence An- A 
sequence (An) is called nondecreasing in case An C An+i for 
every n, and nonincreasing in case An D An+i for every n. In 
either case it is called monotonic. A monotonic sequence of sets 

always has a limit. In the nondecreasing case, lim An = ^ An, 

and in the nonincreasing case, lim An = [1 

The following examples in two-dimensional space illustrate 
the preceding definitions. 

N. The set An consists of the interior of the circle with center 
at (n, 0) which passes through the points (0, 1) and (0, —1). 
Then lim An consists of the points {x, y) in the finite part 
of the plane for which x> 0 and the points on the open 
segment from (0, 1) to (0, —1). 

P. The set An consists of the interior of the circle with center 
at (( — 1)”?^, 0) which passes through the points (0, 1) and 
(0, —1). Then lim inf An consists of the points on the 
open segment from (0, 1) to (0, — 1), while lim sup A« con- 
sists of the entire finite part of the plane except for those 
points on the 2 /-axis for which \y\ ^ 1. 

4. Some Fundamental Definitions and Theorems of Point- 
set Theory. — ^By the €-neighborhood NQ); e) of a point b = (6^^^, 

. . . , 6^*^) in i;-dimensional space is meant the set of aU points Xj 
finite or infinite, such that < € if is finite; x^'^ 

< — 1/e if = — 00 ; > 1/g if ? for i — 1, . . , A;. 

It is supposed, of course, that e > 0. A useful consequence 
of this definition is that, if a point c is in the neighborhood 
NQ); c) and d is in N(c; e), then d is in NQf; 2e) provided 26^ g 1 
when b has one or more infinite coordinates. Furthermore, 
6 5*5 c O * 3€ > 0 9* NQ); €)N{c; e) = 0, that is, if b and c are 

^It should be noted that occasionally an author will use the symbols 
lim inf and lim sup A» with a different meaning. 
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distinct points, there is a positive number e, such that the neigh- 
borhoods JV(6; e) and JV(c; «) have no points in common. 

If /S is a set of points, 

N{S-, e) = ^ N{h) €). 

binS 

that is, the neighborhood N{S;e) consists of all points x that lie 
in the e-neighborhood of some point b of S. 

A point b is interior to a set /S in case 3^ > 0 r N(b; e) C S, 
that is, in case there exists a neighborhood N(b] e) containing 
only points of S, A point b is exterior to /S in case 3e > Or 
SN{b; e) = 0, that is, in case there is a neighborhood N{b; e) 
containing no points of S, A point b is a boundary point or a 
frontier point of 5 in case e > 0 O * N(b; €)S ^ 0. N(b; e)cS 0, 
that is, in case every neighborhood ^(6; e) contains at least one 
point in S and at least one point not in S. The set of all the 
boundary points of a set S is called the boundary or frontier of S, 
It is easy to see that a point is a boundary point of a set if and 
only if it is neither an interior point nor an exterior point of the 
set. Thus with respect to a given set S all points of space are 
classified into three mutuaUy exclusive classes: interior points, 
exterior points, and boundary points. A boundary point of a set 
may belong to the set or not. . 

A set of points having b as an interior point will also be called a 
neighborhood of b, and denoted by A(b), when it is not important 
to specify the character of the neighborhood. Every neighbor- 
hood N(b) contains an e-neighborhood N(b; e). Thus the 
interior of a circle in the plane constitutes a neighborhood of each 
of its points. A deleted neighborhood of b is obtained by striking 
out the point b from a neighborhood of b. As in Chap. I, we 
shall use the notation (b} for the set consisting of the single 
element b. 

A point b is an accumulation point or a limit point of a set S 
in case e > 0 O* ■Ar(b; e)S — {b} 0, that is, in case every 

deleted neighborhood of b contains points of S. A point b is an 
isolated point of a set S in case Be > 0 N{b; €)S == {b}, that is, 
in case b belongs to 8 and there is a neighborhood of b containing 
no other point of 8. 

Theorem 1. In every neighbcrrhood of an accumulation point 
of 8 there are infinitely many points of 8. 
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Proof , — ^If Xi is a point of S distinct from &, then 3€i > 0 Xi 
not in iV(6; e^). If only a finite number xi, X 2 j , * . ,Xn of points 
of S distinct from 6 lie in a neighborhood N{b; co), the smallest 
of the numbers ei, is a positive number e, and iV'(6; e) 

would contain no points of S distinct from 6. 

The following theorems are left to the reader as exercises. 

Theoeem 2. Every interior point of S is an accumulation point 
ofS 

Theoeem 3. An accumulation point of S is either an interior 
point of S or a boundary point of S, 

Theoeem 4. A boundary point of S is either an accumulation 
point of S or an isolated point of S. 

The derived set or derivative of a set 5, denoted by S\ is the 
set consisting of all the accumulation points of S, The set 
jS + is frequently called the closure of S and denoted by S. 
A set S is called closed in case it contains all its poiats of accumu- 
lation, i.e.j in case S' Cl S. A set S is called open in case it is 
composed entirely of interior points. It is readily seen that 
every eneighborhood N(b; e) is an open set. 

Theoeem 5. If S C T, then S' C T', and S.C f. 

Theoeem 6. The complement of a closed set is open; vice versa, 
the complement of an open set is closed. 

Proof , — If S is closed and 6 is in the complement of S, then b 
is in the complement of S', and so there is a neighborhood of 6 
containing no points of S, If S is open and 6 is in {cS)', then 
every neighborhood of b contains points of cS, so that b is not 
in S, 

Theoeem 7, Let (Ea) be a family of sets, 5 = ^ Sa, P = H 
If each Ea is closed, the product P is also closed. In case there are 
only a finite number of sets Ea, the sum S is also closed. If each 
Ea is open, the sum S is also open. In case there are only a finite 
number of sets Ea, the product P is also open. 

Proof. — ^If each Pa is closed, we have P' C 11 C O ~ -P* 
If in addition there are only a finite number of sets Ea, and b is 
not in ^ Pa, then 

Of .O • 36a > 0 EaN{b; €a) — {&} = 0. 


Let € be the smallest €«. Then SN(b] e) — {6} — 0, so that b is 
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not in S'. Hence S' C ^ C ^ -2?^ = S. The last part of 
the theorem follows from the first part by use of Theorem 6. 

Theoeem 8. The derived set S' of an arbitrary set S is closed. 
The boundary of S and the closure S of S are also closed sets. 

The proof of the last theorem is left to the reader. From it 
we see that the closure S of S is the minimum closed set contain- 
ing S. 

Note that the property of being closed or open or neither 
depends on the space in which the point set in question is 
regarded as embedded. Thus, the set C of the examples in Sec. 2 
is not closed. But, if we had not introduced the points at 
infinity into the space, the set C would be closed, since it would 
have no point of accumulation whatever in the space. An open 
interval (u, 6) of one-dimensional space is an open set A, but if 
the same set A is regarded as a subset of two-dimensional space 
then A is no longer open. It is sometimes convenient to intro- 
duce the notion of relative closure. A set S is said to be closed 
relative to a set T in case S'T C S C T. A set /S is open relative 
to a set r in case S C. T and T -- Sis closed relative to T. The 
form of the last definition is justified by Theorem 6. 

It should be noted that a closed interval may be represented 
as a product of open intervals, and an open interval may be 
represented as a sum of closed intervals. Also every set is both 
closed and open relative to itself. Example D is closed relative 
to the open interval (0, 2), and D + (-1, 0) is open relative to 
D + [—2, 0]. 

A set T is said to be dense in a set in case S C T\ As a 
special case, a set S is dense-in-itself in case S C A set S is 
nowhere dense or nondense in case it is dense in no interval. 
A set S is perfect in case it is closed and dense-in-itself, i.e., in 
case S = S'. 

The following theorem is frequently useful: 

Theoeem 9. Every infinite set S in the number space contains 
a denumerable subset T such that S ^ T d” T' . If S is dense-in^ 
itself, then T is dense in S. 

Proof.— If space is one-dimensional, we fit a net Gn of intervals 
on it, with end points i/2^, where i ranges over the integers from 
^2^^ to 2^”. Thus each net Gn consists of a finite number of 
intervals of which the first and the last are the infinite intervals 
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(— 00 , —2^) and {2^, +oo), respectively. If space is fe-dimen- 
sional, the net Gn is to consist of the ^^-dimensional intervals 
each of which is the Cartesian product of k intervals chosen from 
the one-dimensional net just described. In particular, in two 
dimensions, the net Gn is composed of intervals with comers 
{i/2^j j/2”), where i and j range independently from — 2^" to 2^^ 
and take also the values — oo and + co . Such a sequence of 
nets is frequently useful. 

To obtain the set T we select from each interval of each net 
Gn a point of S, if there is one. Then for each point a: in S and 
each n, there is an interval in of the net Gn containing x, and 
therefore containing a point of T. Hence x is in T + T\ 
From SC. T + T' vre find S' C T' + T" = T', and from this 
the last statement of the theorem follows. 

From the property 1114 of Chap. II, Sec. 9, it is easy to see 
that the denumerable set Q composed of all points with rational 
coordinates is dense on the number space. An alternative proof 
for Theorem 9 is obtained by selecting a denumeration (j^n) of Q, 
and then selecting from each set SN{Zn] l/n) which is not nuU 
a point t/n, to obtain the desired subset T. 

A set S is said to be disconnected in case it is the sum of two 
disjoint nonnull sets A and B such that neither part contains a 
point of accumulation of the other, that is, 

AB + A'B + AB' = 0. 

A set S is connected in case it is not disconnected. A continuum 
is a closed connected set. A set S is convex in case it contains 
the line segment joining each pair of its points. 

An €-neighborhood of a point 6 is an example of a convex set. 
A convex set is obviously connected. A connected set consisting 
of more than one point is dense-in-itself. A continuum is clearly 
always a perfect set, except in the degenerate case when it reduces 
to a single point. To avoid exceptions, we may agree to call the 
null set open, closed, perfect, and connected. 

Use is occasionally made in analysis of other definitions of 
connectedness than the one given above. A set /S is said to be 
polygonally connected in case every pair of its points can be 
joined by a polygon all of whose points are in /S. A set S is said 
to be arewise connected in case every pair of its points can be 
joined by a continuous arc all of whose points are in S, A con- 
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tinuous arc may be defined as the set of points 

i — 1, •••, k, 

given by k continuous functions of a single real variable 

t on an interval to ^ t ^ h. The properties of continuous func» 
tions are discussed in Chap. IV, Sec. 3. The notion of a con- 
tinuous path curve is discussed in Chap. X, Sec. 7. The set L 
of the examples is arcwise connected but not polygonally con- 
nected, and the set M is connected but not arcwise connected. 
The set L becomes disconnected if the origin is deleted, but the 
set M remains connected when any finite set of points on the 
2 /-axis is deleted. 

Let us consider the set F of the examples of Sec. 2, namely, the 
Cantor discontinuum. This set is closed, since its complemen- 
tary set is a sum of open intervals. It is nondense since a piece 
of every subinterval of [a, b] belongs to an interval of the com- 
plementary set, but it is dense-in-itself (and hence perfect) since 
in every neighborhood of a point of F there are intervals of the 
complementary set and hence end points of these intervals. It 
is disconnected, and all its points are boundary points. Let the 
interval [a, 6] be the interval [0, IJ, and let the points of this 
interval be represented in the ternary system (sometimes called 
the ‘^decimal system with base three ^0* ^ points that can be 
represented exclusively in terms of the digits 0 and 2 belong to 
the set F. (We here waive the requirement that the representa- 
tion shall be normal, in the sense of Sec. 10 of Chap. II.) This 
representation could also be used to verify the properties of the 
set F listed above. In the binary system every point of the 
interval [0, 1] has a representation using only the digits 0 and 1. 
Thus there is established a correspondence between the points 
of the set F and the points of the inverval [0, Ij, which is one-to- 
one except that the two end points of a complementary interval 
of F correspond to the same point of [0, 1]. This shows that the 
set F has the same cardinal number as the interval. 

Ex:ekcises 

1. For each set A to E and G to M of the examples, specify 
the set of interior points, of exterior points, and of boundary 

1 For a proof of the equivalence theorem needed here, see Hausdorff [4] 
p. 27. 
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points. Specify also the derived set and the set of isolated 
points. 

2. For each set of the examples, tell whether the set is closed, 
open, dense-in-itself, perfect, or connected. 

3. Determine the boundary points of the one-dimensional sets 

determined respectively by the inequalities: (a) + x <1; 

Q}) -5 <x + -<0. 

4. Prove that an open connected set S having no points at 
infinity is polygonally coimected. Hint: For a given point a in 
S consider the subset A oi S consisting of all points c that can be 
Joined to a by a polygon in S. 

6. Prove that if S and T are connected sets and ST + ST 
+ /S'r 7 *^ 0, then S + T is connected. 

6. Prove that a connected set having an isolated point contains- 
no other point. 

6. Sequences of Ppints, and the Weierstrass-Bolzano 
Theorem. — ^An infinite sequence (xn) of points is said to have 
the point 6 as a limit in case € > 0 : D : 3m a: n > 
in ^^(6; e). When this condition holds, we use the notation 
lim Xn = b. A point b is said to be a point of accumulation of a 
sequence (Xn) in case for every e > 0 there are infinitely many 
values of n for which is in iVCt; e). 

Theorem 10. A sequence (xn) can have at most one point b as 
a limit If lim Xn = 6, the point b is the only point of accumulation 
of the sequence. 

Theorem 11. If b is a point of accumulation of a set Sj there 
exists a sequence (a;„) of distinct points of S such that lim Xn = b. 

n= « 

If b is a point of accumulation of a sequence (xn), there is a subse- 
quence {xnf) such that lim 

A set is said to be bounded in case there exists an e-neighbor- 
hood of the origin containing S. 

Theorem 12. The Weierstrass-Bolzano theorem. Every 
infinite set S has at least one poiM of accumuhtionj finite or infinite. 
If S is bounded, its points of accumulation are finite. 

Proof. — We fit a sequence of nets Gn on the space, as in the 
proof of Theorem 9. Since the set S is infinite, at least one 
interval of the net Gi contains infinitely many points of S. Let 
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[<ii, ii] be such an interval. Likewise at least one interval 
[as, 62] of the net G2 which is a subinterval of [ai, 61] contains 
infinitely* many points of S, Proceeding thus, we define by 
induction a nonincreasing sequence of intervals [a^, bn] from the 
respective nets Gn, each of which contains infinitely many points 
of S. The coordinates ^ nondecreasing sequence and 

the coordinates form a nonincreasing sequence, for each 
A == 1, • • • , ifc. If == + <» for every n, then lim,» a$f^ 
= + 00 . If a 5 f ^ — 00 for every n, then lim„ = — co . In 

every other case the sequence is bounded above, the 

sequence is bounded below, and hence both converge to 
the same limit. Let = limn a^n = b^n\ where may 
be + 00 or — 00 . Thus a point c is determined which is contained 
in every interval [Un, bn] of the sequence selected above. More- 
over every neighborhood of c contains all the intervals [un, 6n] 
from a certain one on, so that c must be a point of accumulation 
of 

The theorem .we have just proved is frequently stated under 
the additional hypothesis that the set S is bounded. This addi- 
tional hypothesis would be necessary if we had not adjoined to 
space the points at infinity. The proof we have given covers 
both cases. The same remarks apply to the following four 
corollaries: 

Corollary 1 . Every infinite sequence (a:») has at least one 
point of accumulation^ finite or infinite. 

Proof. — In case the same point c occurs infinitely many times 
in the sequence, it is by definition a point of accumulation. In 
case no point occurs infinitely many times, the set of points 
contained in the sequence is itself infinite, and the theorem 
apphes to it. 

Corollary 2 . If an. infinite sequence has just one point 
of accumulation c, then lim Xn = c. 

Proof. — If the conclusion were not so, there would exist a 
neighborhood Nic; e) such that Xn is not in iV(c; e) for infinitely 
many values of n. Then this subsequence of (xn) would by the 
theorem have a point of accumulation distinct from c. 

Corollary 3 . If (En) is a nonincreasing sequence of closed 
sets, the sets En have at least one point, finite or infinite, in common. 

Proof. — Select a point Xn in each En- The sequence {xn) has a 
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point of accumulation c, by Corollary 1. If Xn — c for infinitely 
many values of n, then c is in all the sets Enj since the sequence 
(En) is nonincreasing. In the remaining case there are infinitely 
many distinct points in the sequence (xn), and Xn is in Em for 
n> m. Thus c is a point of accumulation of each set Em and 
so belongs to each Em since each Em is closed. 

It is interesting to note that a special case of this coroUary was 
proved and used in the proof of the theorem itself. As an exam- 
ple, we may consider the sequence of one-dimensional sets En 

where En = E^[n ^ x\. Then J] En reduces to the point + oo . 

This illustrates the fact that, if we had not introduced the points 
at infinity, we should need the additional hypothesis that the 
sets En are boxmded. 

Corollary 4. If S and T are closed point sets hewing no com- 
mon point j there is a number e 0 such that the neighborhoods 
N(S] e) and N(T; e) have no common point 

Proof . — If not, there exists a sequence (e^) of positive numbers 
approaching zero, a sequence (an) of points of S, and a sequence 
(6n) of points of T, such that each pair of neighborhoods iV’(an; en) 
and N {bn} €n) has a point dn in common. The sequence (a„) has 
a point of accumulation c, by Corollary 1, and by Theorem 11, 
there is a subsequence (anj such that lim an* = c. Suppose 

for simplicity of notation that lim = Ci. Then by hypothesis 

OO 

c is a point of S and ci is a point of T, and so c 9 ^ ci. But 
lim dn* = c, and lim dn* = Ci, which is in contradiction with 

00 h =‘ 00 

Theorem 10. 

As an example, let S be the Cantor discontinuum F and let T 
consist of the mid-points of the complementary intervals. Then 
every pair of neighborhoods N{S;€) and A* {T;e) will have a point 
in common. But if we omit from T aU but a finite number of 
its points, the conclusion of the corollary will hold. Another 
example in which the conclusion of the corollary fails is obtained 
by letting S consist of the points on a hyperbola and T of the 
points on the asymptotes. 

6. The Heine-Borel Theorem— A family ^ of regions Q is 
said to cover a point set S in case each point of S is interior to at 
least one region Q of the family 
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Theorem 13. Let S be a closed point set covered by a family § 
of regions Q. Then there is a Unite subfamily, (Qi, . . . , of 
the family % which also covers S, 

Proof. — Suppose the theorem is not true. Consider the 
sequence of successively finer nets Gn used in the proof of 
Theorem 9. Then there is an interval [ai,6i] of the net Gi such 
that the conclusion of the theorem does not hold for the portion 
of S contained in [ai, &i]. Similarly there is an interval [a^, 62] 
of the net G2 which is a subinterval of [ai, bi] and such that the 
conclusion of the theorem is false for the portion of S contained 
in [a2, 62]- By an inductive procedure as in the proof of Theorem 
12 there is defined a nonincreasing sequence of intervals [an, bn] 
which determines a point c belonging to all the intervals [an, bn], 
and also to the set S, since S is closed. By hypothesis the point c 
is interior to a region Q of the class g, and hence all the intervals 
[an, bn] from a certain point on are contained in this Q. This 
contradicts the property by means of which the intervals [an, bn] 
were determined. 

Again it is to be noted that the hypothesis of boundedness is 
usually included in the theorem and may be omitted here only 
because we have included the points at infinity in the space. 

Let us now consider some examples in connection with the 
Borel theorem. In example J, the circxilar regions constituting 
the set also constitute a covering family. But there is obviously 
no finite subfamily that covers J. Next, let 8 be the open 
interval (0, 1). To each point b oi 8 "we may make correspond 
the interval (6/2, 36/2). The family g of such intervals covers 
8 , but no finite subfamily does so. But if we adjoin to the family 
% a neighborhood of the origin, however small, the interval (0, 1) 
will be covered by a finite subfamily of the enlarged family g. 
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The works of Hausdorff, Sierpinski, and Alexandroff and Hopf treat point- 
set theory from an abstract and general point of view, so as to include func- 
tion spaces such as the space of continuous functions discussed in Chap. VII, 
Sec. 4. In an abstract treatment, one may take as the undefined notion 
distance, or neighborhood, or open set, or derived set, etc. When suitable 
postulates are taken as a basis, the other notions of point-set theory may 
then be defined and their properties derived. Several notions in addition 
to those described in this chapter are needed in a general theory, to care for 
the new phenomena that present themselves. 
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FUNCTIONS AND THEIR LIMITS 
PROPERTIES OF CONTINUOUS FUNCTIONS 

1. Introduction. — In Sec. 4 of Chap. I, a function was defined 
as being the same thing as a relation. A function may also be 
described as a correspondence between two classes of objects. 
This correspondence need not be one-to-one, and we do not 
insist that each element of one class actually have a correspond- 
ing element in the other class. If the two classes of objects are 
p = [p] and Q = [g], we may use the following notation for the 
function. For each p in P let g(p) denote the set of all elements 
of Q which correspond to p. Thus g(p) is a subset of Q, which 
may be null. If is a subset of P, let gS denote the logical sum 
of the sets g(p) for p in >S, 

ff'Sf = ^ flr(p). 

pinS 

The subset Po composed of all those elements p for which g{p) is 
not empty is called the domain of the function g. The set 
Qq = gP = gPo is called the range of the function g. The domain 
Po is also called the range of the independent variable p; and the 
range Qo is also called the range of the dependent variable g. The 
latter name is sometimes applied to the whole class Q even when 
some of its elements are not included in the correspondence. The 
function g is said to be single-valued when each set g{p) has not 
more than one element. In practice a function g{p) is frequently 
specified by describing an operation or writing down an expression 
that makes correspond to each value of the independent variable 
p one or more values of the dependent variable q. 

The same correspondence may be regarded from the reverse 
point of view. We use the notation for this inverse fimction, 
which has Qo for its domain and Po for its range. Thus gr^iq) 
consists of all those elements p such that q is in the set g(p). 
Also gr^T consists of ah elements p such that the intersection 
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Tg(j>) is not null. The notation cS is used for the complement 
of the set S. With these notations it is ea^y to verify the follow- 
ing relations which hold for every subset T of Q: 

(1:1) gr^T D T-gP. 

(1:2) g-^cT D cg-^T-g-^Q. 

In each case the class inclusion may be replaced by equality 
whenever the function g is smgle-valued. Corresponding state- 
ments with the roles of g and interchanged are obviously also 
valid. As a simple example, let us consider the following: 
P = {1, 2, 3}, Q = {a, 6, c, d}, ^(1) = {a, &}, ^(2) - {b, c}, 
^^(3) = A. Then = 1, g-^b) = {1, 2}, gr^ic) = 2, g-^(d) 

= A, g~‘^g(l) = {Ij 2}, gg~'^gil) = {a, 6, c}. The reader will 
note that for our present purposes it is unnecessary to distinguish 
between an element a and the class {a} whose only element is a. 

A function ^ on P to Q is a single-valued function with domain 
P and range contained in Q, The theory of limits is applicable 
also to multiple-valued functions, and there are some cases in 
which it is convenient to include such functions. One of the 
phrases on ... to or single-valued'’ will be 

used whenever it is necessary to indicate the restriction to single- 
valued functions. In such cases it is not implied that the inverse 
function is single-valued. We shall be dealing in the sequel 
principally with functions whose domain is a set S m /c-dimen- 
sional space and whose range is likewise in a space of one or more 
dimensions. A real-valued function is one whose range is con- 
tained in one-dimensional space. When multiple-valued real- 
finite-valued functions / and g are to be added, the values of 
/(p) and of ^(p) are added in all possible combinations to obtain 
the set of values of / + g sAp. The same understanding applies 
to multiplication and to other operations. When algebraic 
operations are not involved, we frequently permit the values 
+ 00 , and — 00 , as in Sec. 2 of this chapter and m Chaps. X to 
XII. 

A function g whose domain and range are both one-dimensional 
is said to be nondecreasing in case p(xi) ^ g{x^ whenever 
x\ > X 2 - When the function g is multiple-valued, the inequality 
g{x^ ^ g{x^ is supposed to hold for every pair of functional 
values corresponding to xi and The term nonincreasiag has 
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a corresponding definition. A monotonic function is one that 
is either nonincreasing or nondecreasing. 

2. Upper and Lower Bounds and Limits of Fxmctions, — In 
this section we shall be discussing a function / whose domain S 
and range T are subsets of number spaces, and c will denote a 
point in the closure S of /S. The following definition of limit 
generalizes the one discussed for sequences in Chaps. II and III : 
]imf(x) = 6 :^ ; € > 0 : D : 3N{c) ^:x ia N(c)S * D C iV’(6;€) 

x-c 

The class inclusion sign is used in this definition because for 
multiple-valued functions f(x) may stand for a set of points 
rather than for a single point. The logical form of the definition 
is entirely unchanged from that given in Chap. II, Sec. 10; only 
the form of the restrictions on the variables is generalized. The 
limit bj when it exists, is always a point of the number space 
containing the range T of /. The following fundamental theo- 
rem is easily verified: 

Theorem 1. If a function f{x) has a limit at x === c, it has only 
one. 

We shall sometimes wish to consider only the values of the 
function / corresponding to a subset So of its domain S. We may 
then use the phrase ^^f as on So” for such a section of the func- 
tion /. When 5o is a proper subset of S, the section / as on So 
is regarded as a different function from the original function /. 
Thus / as on So may have a limit 6 at a point c in when no 
Umit exists at c for the original function/, since the above defini- 
tion may be satisfied when S is replaced by So though not for S. 
However, if 6 is the limit at c of /, then 6 is the limit at c of / as 
on So, provided c is in So- For example, let S be one-dimensional 
space, f{x) = x'^ for x rational, f{x) = 1 for re irrational. If So 
consists of the rational points, lim f{x) = 0 over So, that is, fix) 

a ?=0 

as on /So has the limit 0 at re == 0. For another example let 
/(re) = 1/(1 + and let So be the positive end of the re-axis. 
Then the limit of / as on /So at re = 0 has the value 0. This is 
also called the right-hand limit of /(re) at re = 0. The left-hand 
limit of the same function at re = 0 has the value 1. For a right- 
hand limit at a point c we may also use the notations hm /(re) 

x=c+ 

and /(c + 0), for a left-hand limit the notations lim /(re) and 
/(c — 0) . We imderstand that the subset So over which the limit 
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is taken consists in the first case of the points a; in 5 such that 
X > c, and in the second case of the points a: in S such that 
X < c. The right-hand limit /(c + 0) can have a meaning only 
when c is a right-hand accumulation point of S, that is, when c 
is an accumulation point of the subset of S lying to the right of c. 
A corresponding statement holds for the left-hand limit. 

In defining limits many authors use only deleted neighborhoods 
JV(c). This usage may be included under the definition given 
above, by excluding the point c from 8, i.e,, by considering/ as on 
S — {c}. Thus the definition we have adopted is more flexible. 
We note that when c is in ;S, and lim f{x) exists, it must equal 

/(c), and so / must be single-valued at c. When one-sided limits 
are being considered, it is convenient to exclude the point c, as 
was indicated above. Thus the value /(c) has nothing to do 
with the existence or value of the limits /(c + 0) and/(c — 0). 

For the following paragraphs until we come to Theorem 12 
we shall be considering only real-valued functions. 

The least upper bound of a function f(x) on a set 8 is defined 
to be the least upper bound of the set /S composed of all the 
functional values. We shall use the abbreviations “l.u.b. f{x) 
on 8^^ and ^^B/(a;).” The greatest lower bound of f{x) on 8, 
abbreviated “g.l.b. f{x) on 8^^ or is defined in cor- 

responding fashion. 

Theorem 2. If the set 8 is in one-dimensional space, a mono- 
tonic single-valued function f defined on 8 has a right-haTid limit 
at each right-hand accumulation point of 8, and a left-hand limit at 
each left-hand accumulation point. 

Proof. — Let us assume for definiteness that / is nondecreasing. 
Let c be a right-hand accumulation point of 8, and let r = g.l.b. 
f{x) for x> c. Then when r is finite 

€ > 0 O : Bxe > c 91 r ^ f{x^ < r + e, 

and hence c < x <x^' D •/(^) C N{r\ e). The proof for the 
other cases is similar. 

In case the point c is in the closure 8 of the set 8 where / is 
defined, l.u.b. f{x) on 8N{c] 5) is a function g{b) which is single- 
valued and nondecreasing for 5 > 0, and hence has a limit at 
5 == 0, by Theorem 2. This limit is called the upper limit of /(x) 
at c, and is denoted by lim sup f{x) or Hm /(x), that is, 
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lim s\xpf{x) = g.Lb. [l.u.b. f(x) for x in SN{c; 5)] 

= lim [l.u.b. fix) for x in SNic; S)]. 

5 = 0 

A similar definition holds for the lower limit) denoted by 
lim ini fix) or lim /(re). Note that the upper and lower limits 

a;=c a; = c 

always exist, finite or infinite, at every point of the closure of the 
domain of the function. As in the case of limits, we may also 
define right-hand and left-hand upper and lower limits for func- 
tions whose domains lie in one-dimensional space, by replacing S 
by /S[a: > c], etc. For the right-hand upper limit, for example, 
we may use the notations lim sup fix) and /(c + 0). The proofs 

a;=c + 

of Theorems 3 to 9 are left to the reader. In case the function 
fix) is multiple-valued, each inequality is supposed to hold for 
all the fimctional values. This is the reason for the use of the 
sign < in Theorems 4 and 5, meaning that there is at least one 
functional value for which the relation < does not hold. 
Theorem 3. For every function fix), 

lim ml fix) ^ lim sup /(a;). 

® = c a5=c 

Theorem 4. lim sup/(a:) is a finite number U if and only if: 

1. * >0O:3i^(c)9:xiniV(c)O-/(a;) <[/ + «; 

2. e > 0 •^•3xin N(fi; e) i‘f(x) U — e. 

Theorem 6. lim sup/(a;) = + oo e > 0-'^-3x inN(c; e) 

rf(x) < 1/e. 

Theorem 6. lim sapf(x) = — oo « > 0 0 : 3N(c) s: x in 

a;=c 

Nic) • D ‘/(rr) < — 1/e. In this case 3 lim/(rc) = — oo . 
Theorem 7. lim sup f{x) = lim inf /(*) 3 lim/(x) • 3 • 

ic=c a;=c a;=c 

lim sup fix) = lim fix). 

x^c a;=c 

Theorem 8. lim sup/(x) < S O : 3JV(c) s; x in JV(c) • ‘ 

fix) < B. 

Theorem 9. 3iV(c) ?: x in iV(c) O • fi^) ^ 5 O : lim sup fix) 

a; = c 

S B. 

It is worth, while to write out the statements of some of the 
above theoresis for the special case when the function fix) is 
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replaced by a sequence (a„). For example, Theorem 4 in this 
case reads: 

lim sup an is a finite number U if and only if 

eo 

1. € > 0 : 15 : 3ne r,n > an < U + 

2. €>0*mO‘3n>m9*an>C/ — €. 

Fig. 1 illustrates Theorem 4 with c = 0, and Fig. 2 illustrates 
the special case of a sequence. In Fig. 2, n is plotted along the 



Y 



x-axiS; and a» along the y-axis, and all the points of the graph 
to the right of the line x = are supposed to lie below the line 
2 / = ly + €; to the right of every vertical line there lie some points 
of the graph above the line y — U — e. 

Exercises 

1. Write out the theorems corresponding to Theorems 4 to 6, 
8, 9 for lim inf /(a;). 
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2. As an application of Theorem 2, show the existence of 

lim (1 + l/n)% where n ranges over the natural numbers. 

00 

Show also the finiteness of the limit. 

3. Determine the upper and lower limits, and the right-hand 
and left-hand upper and lower limits, at rr = 0 for the following 
functions: 

(a) sin (1/a;); (b) l/x; 

Y W (1/*) sin (X/x). 

4. Let the characteristic function of a set S be denoted by <j>s, 
that is, ^six) = 1 when the point a: is in S, and <t>s{x) = 0 when 
a: is in c/S. Let (A„) be a sequence of point sets, and let L = lim 
inf An, V = lim sup An. (These operations on sets were defined 
in Chap. Ill, Sec. 3.) Show that for each point x, 

.lim inf <f>An(.x) = ^i.{x), Um sup «^A,(a:) = ^{x). 

71= 00 n* « 


The following theorem is Cauchy condition for the existence 
of a finite limit of a ftinction. It generalizes the condition stated 
in Sec. 10 of Chap. II and may be proved in various ways. We 
recall that we are permitting /(a;) to be multiple-valued. 

Theorem 10. Let f(x) he a finite-reaUvalued function defined 
on S, and let c be a point of S. Then a necessary and sufficient 
condition for lim f{x) to exist and he finite is that 

x = c 

(2:1) e > 0 : D : 3N(c) 9 : x and x' in SN(c) • * \f{x) - f{x')\ 

< €. 

Proof . — ^The condition is obviously necessary. To show its 
sufficiency, let b = lim sup /(a;), and let iV'i(c) correspond to 

6 = 1 in (2:1). Then for a fixed point x" of iVi(c) and one of the 
values fix") we have fix") — 1 < fix) < fix") + 1 for all a: in 
Niic) and all values of fix) (in case / is multiple-valued), and 
hence fix") — 1 S & g fix") -f 1, so that 6 is finite. By 
Theorem 4, there exists a point a/ in JV(c) and a value fix') such 
that 


b — e < fix') <6 + 6, 
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and thus 

6 — 2€ < f(x) < 6 + 2€ 

for every x in N(c) and every value of f(x). 

Theorem 11. Suppose the functions f(x) and g{x) are both 
defined on the same set S, and suppose lim f(x) = Aj lim g(x) = B, 

x—c x^c 

with A and B both finite. Then 

(2:2) lim [/‘(x) ± = A ± B] 

(2:3) lim /(a:)g(a:) = AB] 

(2:4) jm/(a:)/g(x) = A/B if £ 5^ 0. 

X = C 

Corollary. If Piy, z), Q{y, z) are polynomials in y and z 
with Q(Aj B) ^ Oj then 

y P[m,g(x)] _ P(A,B) 

x^cQUi^), g{x)]-'WA;^y 

We shall give the proof of (2:3). The proof of the remain- 
der of the theorem is left to the reader. Let e > 0, and let 
€1 < €/(l + 1A[ + \B\) and 0 < €i < 1. Then 3N{c) b:x in 
N{c)S • D • \fix) — A\ < €ij lg(x) — £[ < ei, and hence l^(a;)l 
< 1^1 + 1 ; ^ ~ 
AB\ < eid^l + 1) + < €. It is clear that the corollary 

may be generalized to the case of rational functions of any num- 
ber of functions and that it includes the special case of rational 
functions of f(x) alone. 

Let /(a:) be a function with domain Sj and g{y) a function with 
domain T and range contained in the same space as the set S. 
Then the composite function h{y) = fg{y) has for its domain the 
set ^'^S. When the function g{y) is multiple-valued, the nota- 
tion /gr(2/) means the transform by the function / of the set g{y). 
For such functions, the following theorem is valid: 

Theorem 12. Let lim f{x) = o, lim g{y) = a. Thm lim h{y) 

x—a y^h 

= c, •provided the point b is m Uie closure of the domain 
Proof. — 6 > 0 :i) : 35 > 0 a: xmSN(a; 5) • D -/(a:) C ■lV’(c; «) . 
3Nib ) »: y in TN{b) • D • g{y) C N{a; 6). Thus y in (ff-^S)N(b) 
-Z>-h{y) C N(c-,e). 

Although the theorem is valid in such a case as f{x) — prin- 
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cipal value of csc”^ x, g{y) = sin y, its result may be trivial. 
In this example consists of the odd multiples of t/2, • 

Theorem 13. A necessary and sufficient condition for the exist- 
ence of lim f(x) is that for each sequence (n;«) in S with lim Xn ^ a 

X — a 00 

the corresponding sequence (f{Xn)) has a limit. 

Proof. — ^The necessity of this condition is a special case of 
Theorem 12. To show the sufficiency of the condition, we note 
first that lim f(xn) has the same value for all sequences (xn) whose 

71= to 

limit is a. For if two such sequences (xn) and (yn) made hm f{xn) 

, n— 00 

9 ^ lim fiVn), and if we set Z 2 »-i = a:*, Z 2 n = y^, then the sequence 
71= 00 

(/(s^Ti)) would not have a limit. Let c denote this common limit, 
and suppose the condition is not sufficient. Then 3 e > 0 
• D • Hxn in SN (a; l/n) r f(xn) C|I N(c; e). But lim Xn = a, and 

71= eo 

hence lim f{xn) = c, which is a contradiction. ^ 

n— 00 

The following inequalities involving the upper and lower 
bounds and upper and lower limits of sums and differences of 
functions are sometimes useful. 

Theorem 14. Let f and g he real-valued functions defined on 
the same set S. Then the following inequalities hold, provided 
those involving indeterminate forms are omitted: 

(2:5) + + + + 

^ B/ + Bg, 

(2:6) S/-B^SB(/-ff)g{^-g}gS(/-^) 

(2:7) Um / + ^ ^ ^ lim (/ + gr) ^ |= / + i™ 

[lim / + lim gj 

— (/ + ^) ^ lim / + lim g, 

( 2 « 

^ lim (f — g) ^ lim / — Im g. 

In (2:7) and (2:8) all the upper and lower limits are supposed to he 
taken at the same point a of S, 
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Proof , — ^The inequalities (2:5) are readily verified. Those in 
(2:6) follow from (2:5) by means of the fact that B(-"^) = 

Those in (2:7) and (2:8) follow from (2:5) and (2:6), respectively, 
by means of Theorem 11, when the limits involved are finite. 

3. Continuous and Semicontinuous Functions. — In this section 
it becomes less useful to admit points at infinity into the range 
of the functions considered. Therefore for definiteness we shall 
assume throughout this section that the functions considered 
have no infinite values. They may be multiple-valued and are 
supposed to be defined on a set S unless otherwise specified. 

A function f(x) is continuous at a point b in case & is in aS and 
lim f(x) exists. As a consequence of this definition, 

lim /(a:) =/(&), 

x=b 


and / is sin^e-valued at b. It is also evident that when f(x) is 
continuous at 6, f{x) is a continuous fimetion of each variable 
x^^'^ at The converse is not true (see Chap. VII). A real- 
valued function f{x) is lower semicontinuous at 6 in case 6 is in aS, 
/ is single-valued at 6, and lim inf f{x) = /(6), and upper semi- 

continuous at b in case i> is in jS, / is single-valued at b, and 
lim sup f(x) = f(b). It is clear that f(z) is lower semicontinuous 

if and only if —f(x) is upper semicontinuous and with the help 
of Theorem 7 of the preceding section that a real-valued function 
is continuous at 6 if and only if it is both upper and lower semi- 
continuous at 6. In case the domain aS of / lies in one-dunen- 
sional space, we say that f(x) is contmuous on the right at a point 
b in case / as on aSi is continuous at 6, where aSi = AS[a; ^ b]. An 
analogous definition holds for continuity on the left. A function 
/ is contmuous (lower or upper semicontinuous, or continuous on 
the left or right) on a set aSq C m case the corresponding 
property holds at every point of aSq. 

Theorem 15. Let f{x) be upper semicontinuous at 6, and 
f{b) < Uy where u is finite. Then there is a neighborhood N{h) on 
which f{x) < u. Thus S is bounded above on N{b), 

Theorem 16. Let f {x) and g{x) be real-valued functions con- 
tinuous at 6. Then the functions f(x) ± g{x) and fix)g{x) are 
continuous at b. So also is f{x)/g{x)j provided g(}>) 0. More- 

QveTy if P(y, z)y Q{y, z) are polynomials with Qlfib), g(Jb)] 0, 
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then 

Qi/W, gix)] 

is continuous at b. 

Theorem 17. Letf(x) be continuous at x = a, let g(y) be con^ 
tinuous at y — b, and let gib) = a. Then the composite function 
fgiy) is continuous aty = b. 

Theorem 18. Let f and g be two functions continuous on S and 
let fix) == gix) on a subset T of S. Then fix) = gix) on ST. 

As an example to which this theorem applies we note the 
important case when f and g are continuous on an interval (u, b) 
and are equal at the points of (a, b) with rational coordinates. 
They must then be equal at aU points of (a, b). 

Theorem 19. Let fix) and gix) be upper semicontinuous at b. 
Then fix) + gix) is also upper semicontinuous at 6. 

Theorems 16 to 19 follow from Theorems 8, 11, 12, 1, and 14 of 
Sec. 2. 

Theorem 20. A necessary and sufficient condition that a 
single-reaLvalued function f with domain S be upper semicontinu- 
ous on S is that the set Su = S[f(x) ^ u] be closed relative to S for 
every real number u, or for every rational number u. 

Proof. — ^The necessity of the condition follows by indirect proof 
from Theorem 15. Suppose that the condition is not sufficient. 
Then there is a point b ol S and a rational number u such that 

(3:1) /(6) < u < lim sup f(x), 

x—h 

and by Theorem 9 every neighborhood iV'(6; e) contains a point x 
of S such that fix) > u. Since S^ is closed relative to S by 
hypothesis, /(6) ^ u, but this contradicts (3:1). 

Theorem 21. Let a and b be two points of a connected set S on 
which fix) is real-valued and continuous, and let fid) < u </(6). 
Then there is in S a point Xo subh that fixo) = u. 

Proof. — Let So = /S[/(a;) ^ u], T = S — So- Since Sq is closed 
relative to S by Theorem 20 and S is connected, So must contain 
a point xq of T\ Since fix) ^ u on T' by the analogue of 
Theorem 15 for lower semicontinuous functions, we must have 
f(xo) = u. 

That a function / may be everywhere discontinuous and yet 
have the property stated in therlast theorem is shown by the 
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following example/^^ Let the number x in the interval [0, 1] be 
expressed as a decimal .aia2a3 . . . . . . . If the decimal 

.aia^a^ar * * * is not periodic, set /(a;) = 0; if it is periodic and the 
first period commences with a 2 n~i, set /(a:) = .<a^ 2 na 2 «+ 2 « 2 n-f .4 * • • . 
In every subinterval, however small, of [0, 1], this function takes 
every value between 0 and 1, and consequently it must be every- 
where discontinuous while stiU satisfying the conclusion of the 
last theorem. 

A real-valued function / is said to have a TninimtiTn on the set S 
in case the greatest lower boimd of / on is a value actually 
assumed by / on S, and / has a maximum in case the least upper 
bound is a value assumed. The following theorem is a basic 
one for many proofs in mathematics. 

Theorem 22. If S is closed andf is lower semicontinuous on S, 
then f has a minimum on S. 

Proof, — ^Let m = g.l.b. f{x) on S, Then there is a sequence 
(Xn) of points of S, called a “minimizing sequence,’’ such tl^at 
lim f(jXn) = By the first corollary of Theorem 12 of Chap. Ill, 
the sequence (xn) has at least one point b of accumulation, and 
b must be in S since S is closed. By the assumed lower semi- 
continuity of /, f{b) g lim/(a;n) = m, and hence m 5*^ —oo. 
But m ^ f{b) by definition of m, and hence /(&) = m. 

For Theorem 22 the assumption is frequently made that the 
set S is bounded, but this is unnecessary when the points at 
infinity are included in the space. 

In place of the absolute minimum considered in Theorem 22, 
it is sometimes desirable to consider a relative minimum. A 
function / is said to have a relative minimum at a point b of S 
in case 3NQ}) ?:xm SN{b) • D -fix) S f(Jb), 

Theorem 22 has the following corollaries: 

Corollary 1. If S is closed andf is continuous on S, then f is 
bounded on S, 

Corollary 2. Suppose S is a closed set contained in the one- 
dimensional interval [a, &], and that a and b are, respectively, 
right-hand and left-hand accumulation points of S, Suppose 
thatf is lower semicontinuous on S and has relative maxima at a 
and b, Thenf has an absolute minimum at a point between a and b. 

Corollary 3. Let S be a closed set in one-dimensional space, 
and suppose that f is continuous on S and has no relative rnaxima 

^ See Lebesgue, Lecons sur V integration, 2d Ed., p. 97. 
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or minima between the points a and b of S, Then f is properly 
monotonic between the points a and b. 

A function / is said to be uniformly continuous on the set S in 
case 

6 > 0 0:35 > OBixmS • x'mSN(x;8) • • f(x') in. N(f(x); e), 

A slight generalization of this definition is the follo’vving: / is 
uniformly continuous on the subset >So of its domain S in case 

e > 0 ::):35 > 0 ^ixmSo ' x' mSN{x; 8) 

It is evident that, when a function is uniformly continuous on 
Soj it is single-valued and continuous on So. The proof of the 
following converse theorem is based on the Heine-Borel theorem. 
In the proof given by Heine^^^ of this theorem on uniform conti- 
nuity occur the essential ideas of a proof of the Heine-Borel 
theorem, which was stated by Boreb^^ in a more restricted form 
than that given in Chap. III. 

•Theorem 23. Let So be a closed subset of the domain S of /, 
and let f he continuous on So. Then f is uniformly continuous on 
So. 

Proof. — ^Let e be an arbitrary positive number. Then by 
hypothesis, 

a; in So > Oa:a;' in SN{x] 28f) O'/(a?0 hiiV(/(a:); e). 

In case So contains any points at infinity, we also require that 
8x < \/2/2. If to each a; in So we make correspond the neigh- 
borhood N(x; 8x)j this family of neighborhoods plainly covers 
the set So- Hence by the Heine-Borel theorem there is a finite 
subset T of So such that a; in So O * 3a in T 9 * a: iniV(a; 5a). Let /3 
be the smallest of the numbers 5a for a in T. If a; is in So and a;' 
is in SN(x] 13) then x' is in N(a; 25a), and hence f(x) and /(a;') 
are both in N(f(a);e) and f(x') is in N(f(x); 2€). We note 
that here it is essential that/(a;) be restricted to have finite values. 

Exercise 

Determine which of the following functions are uniformly 
continuous, (a) on the interval 0 < a; < 1; (6) on the interval 
0 < a; < 00 . 

^ Journal far die reine und angewandte Mathematikf Vol. 74 (1872), p.l88. 

** Annales sdentifiq'^^s de Vicole normale sup^rieurej Series 3, Vol. 12 (1895), 
p. 51. 
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1. l/(x - 1). 2. 3. l/(x - 2). 

4. 5. sin a;. 6, sin (1/x), 

* Theorem 20 suggests that continuous functions might be 
characterized by the closure of the inverse transforms of closed 
sets. It is sometimes convenient to characterize them by means 
of the closure of their graphs. We now state some theorems of 
these types. 

* We note that every set W of points w = {x, y) in the Car- 
tesian product of a;-space and tz-space may be regarded as the 
graph of a (possibly multiple-valued) fimction y = fix), whose 
domain S is the a;-projection of W and whose range T is the 
2 Z-projection of W. With these notations we state the following 
theorems: 

* Theorem 24. If W is closed, then its x-^rojection S and its 
y-projection T are closed. If W is open, then S and T are open. 

Proof, — ^If a; is in /S', and lim Xn = x, where the sequence (Xn) is 

n= « 

chosen from S, then a corresponding sequence (a;„, yn) chosen 
from W has a point of accumulation {x, y) in W, and hence x is 
in S, To prove the last statement of the theorem we note that, 
if N{x, y; e) C W, then N{x; e) C S, 

* Theorem 25. When the function f is single-valued, a necessary 

and sufficient condition that f he continuous is that whenever To is 
closed relative to T, is also closed relative to S, A second 

necessary and sufficient condition is that whenever Tq is open relative 
to T, /“K^o) is also open relative to S, When f is single-valued 
and its domain S is hounded and closed, a third necessary and 
sufficient condition that f he continuous is that its graph W he 
hounded and closed. In this last case, for every closed subset So of S, 
/(/So) is also closed, and whenever To C T andf^^iTo) is open rela- 
tive to S, To is open relative to T, 

Proof. — ^To prove the necessity of the first condition, let 
lim Xn = X, where Xn is in/”'^(!ro) and xismS, Then lim f(xn) 

71 = « n=> 00 

= f(x), f(x) is in To, and so x is in /"^(ro). Since / is single- 
valued, — To) = S — f~KTo), and so the first condition 

implies the second. The second condition is sufficient for / to be 
contiQuous, since, for each e > 0 and each xo in. S, To = TN ( 3 / 0 ’, e) 
is open relative to T, where yo = f(xo), and. so f~\To) is open 
relative to /S. Thus there is a number 5 > 0 such that SN (xo; S) 
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C f'^KTo), To prove the necessity of the third condition, we 
note that f{x) must be bounded, and that every convergent 
sequence of points (x^j f{xn)) in the graph W must have its limit 
in W. To prove the sufficiency of the third condition, suppose 
that f is not continuous at Xo, Then there is a point yo ^ f(xo) 
and a sequence (xn) in S such that (xn, f{xn)) converges to (a^o, yo). 
Then {xo, yo) is in PF, and so yo == f(xo)j which is a contradiction. 
To prove the final statement in the theorem, consider a sequence 
of points 2/» = f(xn) in /(So), converging to a point yo. The 
sequence (xn) has a subsequence converging to a point xo 
in So- Then since / is continuous, yo = f(xo), and so yo is in 
/(So). The proof for the case when/“’^(!ro) is open relative to S 
is obtained by considering the set So = f~^iT — To)- 
We note that the transform /(So) of an open set So may fail 
to be open, as in the example f(x) = x^ — Sx, So = (—1.5, 1.5), 
where /(So) is the closed interval [—2, 2]. 
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FUNDAMENTAL THEOREMS ON DIFFERENTIATION 

1. Functions of One Variable. — In this section we shall con- 
sider only single-real-finite-valued functions whose domain is a 
point set in one-dimensional space with the points at infinity 
omitted. Let the function / have domain S, and let c be a point 
of S which is also an accumulation point of S. Then /is said to 
have a derivative or a differential coeflBLcient at c (over S) in case 

exists, where the limit is of course taken over the set S with the 
point c excluded. The derivative /'(c), when it exists, may be 
finite or have either of the values -h ^ — oo . In case c is a 
right-hand accumulation point of S and the limit exists when 
taken over the subset of S to the right of c, it is called the right- 
hand derivative, or the derivative on the right, and may be 
denoted by /'“‘“(c) when occasion arises for a distinguishing nota- 
tion. The left-hand derivative may be denpted by /'“(c). If 
gix) = -fi-x), theii^-(-c) =/'+(c), g'+(-c) =/'-(c). 

Theobem 1. Let f have a finite derivative at c. Then 3M 
< oo • 3e > 0 a; in SN(c; e) O * \f{^) — f{o)\ ^ M\x — c\. 
Hence f is continuous at c. 

The usual calculus proofs show that if two functions / and g 
have finite derivatives at c, then their sum, difference, product, 
and quotient have derivatives at c, given by the usual formulas, 
provided, in the case of the quotient, that the denominator is not 
zero. In the case of the sum, one or both of the derivatives may 
be allowed to be infinite, except that they may not have infinite 
values of opposite sign. In the case of the product, we may allow 
the derivative of one factor, say g, to be infinite, provided g is 
continuous at c, and we agree to replace fg' by 0 in case/ vanishes 
at c. Under the same restriction, we may in the case of the 
quotient f/g allow either / or gr to have an infinite derivative. 

69 
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For the mth derivative {x) we adopt the usual inductive 
definition, that is, we say that f{x) has an mth derivative 
at a point c in case /(a;) has an (m — l)st derivative (a;) at 
each point of a neighborhood N{c), ojid (x) has a derivative 
at c. The usual modification is made in case c is an end 
point of the interval of definition of f{x). 

Theorem 6. Extended theorem of the mean, or Taylor’s 
formula with remainder. Suppose that f(x) and its first m — 1 
derivatives are defined and continuous on the closed interval [a, 6], 
and that the mth derivative f^^^{x) exists, finite or infinite, at each 
point of the open interval {a, b). Then there is a point Xq of the 
open interval {a, h) such that 


m = m + (6 - a)f'(a) + • • • 


ml 


Proof , — ^Let 


g{x) =/(fe) -fix) ^ ih^x)rix) 

_ jb - a;)"-* , , _ (6 - a:)’” 

(m-1)!-^ W ml 


where P is a number such that g{a) = 0. Then also gib) = 0 
and g has a derivative g\x) = [P — fi^'^ix)]ib — x)”^~^/im — 1) !. 
Hence the conclusion follows at once from Rollers theorem. 

Theorem 7. Differentiation of a function of a fimction. 
Suppose that the function fiu) has a finite derivative fia) at a 
point a of its domain S, and that gix) has a finite derivative g'Q)) 
at a point b of its domain T, Suppose also that gQ)) = a, and 
that b is an accumulation point of the domain To of the composite 
function hix) — figix)). Then the function h has a derivative at 
b, and h'ib) = fia)g'ib). 

Proof . — ^In case there is a neighborhood Nib) such that gix) 
9 ^ gib) whenever a; is in the deleted neighborhood Nib) and in T, 
the usual proof applies. In the contrary case, every deleted 
neighborhood NQ)) contains a point xiaT such that gix) = gib). 
Thus we must have g'ib) = 0. Let Ti denote the subset of T 
for which gix) « gifi), and let T 2 = To - Ti. For x in Ti, 

hjx) - hjb) ^ 

X — b ’ 
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and hence the derivative of /i at 6 over Ti is zero. If b is an 
accumulation point of ^2, the derivative of h at h over is also 
zero, since the usual proof applies on and g'Q)) = 0. 

An example in which the usual calculus proof is not valid is 
obtained by taking g{x) = sin {l/x) for a: 5^ 0, ^(0) = 0. 

*When a fimction f{x) does not have a derivative, it is some- 
times useful to consider the one-sided upper and lower limits of 
the difference quotient, which alwa3’'s exist when we admit the 
values ± 00 . Let the domain S of / be the closed interval [a, 6], 
and let the difference quotient or incrementary ratio 

fix,) --fix,) 

Xi — X2 

be denoted by I (xi, x ^) . It is clear that J is a sjunmetric function 
of its arguments. Let the variable t be restricted to small positive 
values. Then 


lim sup I(x+ij x) 


is called the upper right-hand derivate of / and denoted by 
D^{x), The lower limit of -f- 1 , x) is called the lower right- 
hand derivate of / and denoted by D^{x), The left-hand deri- 
vates, denoted by D~‘(x) and D^(x), are defined in a similar way. 
The notations D+f{x)j D+f{x), D^J{x) will be used when 

it is desirable to indicate the dependence of these functions on 
the function /, as in Chap. X, Sec. 5. The right-hand derivates 
are of course not defined at 6, and the left-hand derivates are 
not defined at a. When all four derivates are equal at a point, 
the function has a derivative at the point. As an example, the 
function }{x) = a; sin (1/a:), with /(O) = 0, has upper derivates 
at a; = 0 equal to +1, and lower derivates equal to —1. The 
function 


Six) = 


x^ sin (1/a:) 
1 + e*/* ’ 


/(O) = 0, 


has at a: == 0 a right-hand derivative equal to zero, an upper 
left-hand derivate equal to + > ai^d a lower left-hand derivate 
equal to — 00 . 

*Theoi?em 8. Let f(x) be corUinusms on [a, &], let U = l.u.b. 
I{xi, X2) on [a, 6], L = g.l.b. J(a:i, 0:2) on [a, b], and let e > 0. 
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Then there exist infinitely many points x of [a, 6] at which both the 
right-hand derivates D'^{x) and D+{x) lie in the neighborhood 
N(U; e), and there also exist infinitely many points at which both 
the left-hand derivates D~(x) and D~(x) lie in N{T]] i). A cor- 
responding statement holds with U replaced by L, 

Proof . — Let <j>{x) = [I{x, a) — IQ), a)](x — a). Then <f>(x + t) 
- <j>(x) = t[I(x + t,x) - IQ), a)], <^{x - t) - 4>{x) = -t[I{x - t, 
x) ~ IQ), a)]. On an interval on which is not monotonic it 
must have either a maximum or a minimum at a point interior 
to that interval, by Corollary 3 of Theorem 22 in Chap. IV. 
Thus, either the interval [a, b] can be divided into a finite number 
of subintervals on each of which <l>(x) is monotonic, or else (j>{x) 
has an infinite number of maxima and minima. For a; and x ± t 
on an interval where <l>(x) is nondecreasing, we have 

(1:2) I{x + t,x)^ IQ), a), 

(1:3) I(x — t, x) ^ IQ), a), 

and on an interval where <l>{x) is nonincreasing we have 

(1:4) I(x + t,x) ^ IQ), a), 

(1:5) I(x — t, x) ^ IQ), a). 

In case ^ has a minimum at x, (1 :2) and (1:6) hold for sufficiently 

small t, while if has a maximum at x, (1:3) and (1:4) hold. 
Thus in all cases each of the following pairs of inequalities 

(1:6) D^{x) ^ IQ), a), D+{x) ^ IQ), a), 

(1:7) D-(rc) ^ 1(6, a), D^{x) ^ 7(6, a), 

(1:8) D+{x) ^ IQ), a), D+{x) g 7(6, a), 

(1:9) D-{x) ^ IQ), a), D^{x) g 7(6, a), 

is verified for infinitely many points x in the interval (a, 6). 
Now let the subinterval (a, jS) of (a, 6) be so selected that I {a, /?) 
lies in the neighborhood The desired conclusion follows 

from the inequalities (1:6) and (1:7) with a and b replaced by 
a and p, since TJ is obviously an upper bound for each of the 
derivates. In a similar way the inequalities (1:8) and (1:9) 
yield the part of the theorem relating to the lower bound L. 

*CoROLLARY 1. All of the functions I{x\, x^, 7)+(a;), D+(x), 
D“(x) and D^{x) have the same least upper bound and the same 
greatest lower bound on the interval [a, 6], and the value of each 
bound is unchanged if the closed interval \a, 6] is replaced by the 
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O'Pen interval {a, b), (Here the values of i>+(6), Z)+(&), 

D^(a), if defined, must be omitted from consideration.) 

*CoROLLARY 2. /(6) — f(a) = jn(6 — a), where fx ie a number 
between the upper and lower bounds of an arbitrary one of the 
derivates of f. 

The second corollary is a generalized form of the theorem of the 
mean. 

*CoROLLARY 3. If One of the four derivates of f is continuous 
at a point c, so are the other three, and all four have the same value 
at c, so that the derivative f {c) exists. 

Proof. — If Z)+(rr) is continuous at c, the upper and lower 
bounds of D^ix) (and hence also of the other three derivates) 
on a sufficiently small interval containing c will be arbitrarily 
near D^{c). From this the result stated readily follows. 

2. Differentiation of Functions of Several Variables. — In this 
section we consider single-real-finite-valued functions whose 
domain is a point set in the ^--dimensional number space. It is 
more convenient in this section as in the preceding not to include 
the points at infinity in the domain of the functions concerned. 
For such functions of several variables, the notion of total differ- 
ential assumes considerable importance. Without it we could 
not obtain theorems generalizing those of Sec. 1. Note that 
most of the definitions and theorems generalize at once to the 
case when the values of the functions considered lie in a space of 
any finite number of dimensions with the points at infinity 
excluded. 

For present purposes it is convenient to define a linear function 
f{x) to be one whose domain is the whole finite space and which 
satisfies the equation 

f{aiXi + a 2 X 2 ) = a{f(xi) + a^ix^ 

for every pair of points xi, X 2 and pair of real numbers ai, a^S^'^ 
An equivalent definition states that a linear function fix) is one 
expressible in the form 

(2:1) fix) = + • • • + 

where the coefficients <f>i are real numbers. 

^ Here aiXi + a2X2 denotes the point whose coordinates are -f a2X2^^, 

. . . , + a 2 X 2 ^\ 
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A bilinear function g{x, y) is one which is linear in x for each 
and linear in y for each x. An equivalent definition states that 
a bilinear function is one expressible in the form 

k 

g(x, y) = ^ 

1 

The norm of a point Xj denoted by ||:r||, is defined to be the 
greatest of the numbers The norm is a generalization of 

absolute value and has analogous properties. A norm could be 
defined in various other ways, for example, as the distance of x 
from the origin. For a finite point c it is plain that the neighbor- 
hood N{c] e) consists of all points x such that ||a; — c|| < e. 

Theoeem 9. 1} fix) is linear then 3M < ^9:x - ^ • \fix)\ 
^ M\\xl 

It is plain that for a given/ the set of all such numbers M is a 
closed set. Its greatest lower bound is denoted by ||/|| and 
called the norm of /. With our definition for \\x\\j the expression 
(2:1) leads to the formula 

11/11 = I \M. 

Now let / be an arbitrary function with domain Sj and let 
c be a point in S which is an accumulation point of S, Then / 
is said to have a differential dfic; z) at c in case the function df 
is linear in its second argument z, and 

€ > 0 0:3Nic) 9:^xm SNic) 'D-\fix) -/(c) - dfic; x - c)| 

g e\\x — c|l. 

It is often convenient and suggestive to use the symbol dx for 
the second argument of the differential df. 

It is clear from the definition that a function of a single real 
variable has a differential at c if and only if it has a finite deriva- 
tive at c. But for functions of more than one variable the situa- 
tion is slightly different, as is indicated below. 

Theoeem 10. Let f have a differential at the point c. Then 

3M < 00 .36 > I)9\xm. SNic; e) O* \fix) “/(c)| -^M^x — c\\. 
Hence f is continuous at c. 
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The preceding theorem is a generalization of Theorem 1. 

Theorem 11. If f has a differential df{c; dx) = <^idx^^'^ 
4* * • • + dx^^^ at an interior 'point c of its domain S, then f 

has finite first partial derivatives at c, and the partial derivative 
with respect to x^^^ equals Hence in this case the differential is 
uniquely determined. 

It follows from Theorem 11 that when f{x) has a differential 
at a point c interior to its domain S, this differential is the sum 
of the differentials of the fc functions obtained from/( 2 :) by fixing 
all but one variable. A simple example in which the differential 
is not uniquely determined is obtained by taking for the domain 
8 oif the set of points {x, y) in two-dimensional space for which 
\x\ ^ 2/^ and taking f(x, y) x^ + y^. Then a differential at 
the origin df (Oj 0; dx, dy) = <pidx + (p^dy must have 02 = 0, 
but (pi is quite arbitrary. The converse of Theorem 11 is 
not true, as is shovm by the following example. Let /(rr, y) 
== xylix?' + 2 /^) for (x, y) (0, 0), /(O, 0) = 0. This function 
is discontinuous at the origin, although it has finite partial 
derivatives everywhere. Another example, in which the function 
is continuous but still does not have a differential at the origin, is 
obtained by setting /(x, y) = xt^/Cx^ + for (x, y) 5 ^ (0, 0), 
/(O, 0) = 0. However, Theorem 11 has the following partial 
converse: 

Theorem 12. Let c be an interior point of the domain 8 such 
that f has finite first partial derivatives at each point of a neighbor^ 
hood N (c) which are continuous at c. Then f has a differential at c. 

The proof is made by means of the theorem of mean value. 
A slightly more general theorem is indicated by Pierpont [2], 
page 271. 

Theorem 13. 8uppose that each of the h functions 
with common domain T, has a differential dg^^^ic; dz) at c, and 
that the function f(x) has a differential dfQ>; dx) at b ^ gic). 
Then if c is an accumulation point of the domain of the xom- 
posite function h{z) ^f\g{^)\, h has a differential dh{c; dz) 
= df\b;dg{c;dz)] at c. 

Proof . — ^It is plain that the function dh{c; dz) is linear in its 
argument dz. Suppose € > 0. By hypothesis, 

35 > 0.: |!x ~ &II < ^O^fix) -fib) -- dfib) X - b)\ 

s - &li. 
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By hypothesis and by Theorem 10, 

3ikf • 3j8 > 0 3 : ||3 - c|I < /3 O • llfir(z) - i\\ ^ M\\z - c]] < 5. 

Ils-Cz) - g{c) - dg{c; 2 - c)|| ^ e\\z - c\\. 

■ Note that M is independent of e. Hence for \\z — cj] < ;8 we have 

1 ^( 2 ) — hie) — df[b; dg(c; z — c)]| g l/[fl'(2)l - fib) 

— df[b', gi^) — ^']| + \df\b‘, S'(z) — b — dgie; 2 — c)]l 

g .M\\z - cll + ||d/||a ||2 - c|i. 

It is interesting to note that the above proof is also a valid 
proof of Theorem 7. 

If in the third example following Theorem 11 we set a; = 2 / = 
the resulting fimction h(z) = \z\/y/2 fails to have a derivative 
at 2 ! == 0, although the function / is continuous and has partial 
derivatives everywhere. This with Theorem 13 shows that this 
function / cannot have a differential at the origin. 

By combining the results in Theorems 11 to 13 we obtain 
the usual calculus rules for computing differentials. Thus, if 
f(x) is linear, df(x; dx) = f(dx), and hence d{ax) = a dxj d{x + y) 
^ dx + dy. By fixing first y and then x in the product xy, we 
get linear functions, and hence d{xy) — y dx + xdy. From 
Theorem 13 and these results we have d(J + gr) = d/ + dg, 
d{fg) = f dg + gdf, etc. 

Consider a function /(x) for which df{x] dxi) exists for a; on a 
neighborhood N{c). If for each dxi the function df considered 
as a function of x has a differential d^/(c; dxi, dx^ at c the function 
d^f is called the second differential of / at c. It is easy to show 
that d^f is linear in dxi as well as in dx 2 . In a similar manner, 
differentials of all orders may be defined when they exist for the 
function /(r). 

Either of the notations /*<»■> and df/dx^^ may be used to indi- 
cate the first partial derivatives of a function /, with obvious 
extensions for the partial derivatives of higher order. 

A function / is said to be of class C' on an open set S in case it 
has a differential df(x; dx) at every point x of S, and df{x; dx) is 
continuous as a function of x for every value of dx. In gen- 
eral, / is said to be of class on S in case it is of class C', and 
df{x; dx) is of class on S for every dx. By use of Theorems 
11 and 12 and induction it can be shown that an equivalent 
definition is that the function / has aU its partial derivatives 
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up to and including those of order m existing and continuous on 
the set >S. This latter form of the definition is more convenient 
for the type of functions we are considering. 

Theoeem 14. Let the functions fi{x) he of class on S, 
for i = Ij ••• j n, and let P{y) and Q{y) be 'polynomials in y^^\ 
. . . , y^^\ Then P{fix)] is of class on S, and its derivatives 
are expressible as polynomials in /i, . . . , /n and their derivatives. 
If Q[f{^)] 9^ 0 on S, then the quotient P[fix)]/Q[f{x)] is of class 
on Sy and its derivatives are expressible as polynomials in 
fh “ • • } fn and their derivatives divided by appropriate powers of 

Q\fix)l 

Proof. — ^The usual formal proof may be made for the first 
derivatives of sums, differences, products, and quotients. Hence 
by induction the statement of the theorem holds for m — 1. 
The proof is completed by induction on m. 

Theoeem 15. Suppose the fu'nction f{x) is of class on 
the open set S of k-dimensional space, and the k functions 
are of class on the open set T of l-di'mensional space, and 
suppose that the subset To of T for which the point g{z) is in S is not 
null. Then the set To is open, and the function h{z) = f\giz)] is 
of class on To. 

Proof. — ^The set To is open since the functions g^*K^) ^re 
continuous by Theorem 10. The theorem is true for m = 1, by 
Theorem 13, and Theorem 16 of Chap. IV, Sec. 3, and 

dh/dz^ = ^ az/ax® ag®/a2®. 

i 

If the theorem is true for m = p — 1, then the functions 
fx^^[g{z)] and dg^^^/dz^"^ are of class and hence = dh/dz^'> 
is of class by Theorem 14. 

The expression for the second differential, for example, of the 
function h{z) is as follows: 

d%{z] dzi, dzi) = d^f\g{z)) dg{z] dzi), dg{z] fe)] 

+ df\g{z); d^g{z; dzi, dz^)]. 

It should be noted that when derivatives and differentials of 
order higher than the first are concerned, use of the notation 
for dependent variables easily leads to confusion. Strict adher- 
ence to the functional notation is then both safer and simpler. 
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Compare the remarks in Goursat [4], pages 22-26, and Pierpont 
[2], pages 274-279. 

The second differential dxij dx 2 ) of a function / of class 
C" is always symmetric in its differential arguments dxi and dx 2 . 
This is implied by the following theorem on interchange of order 
of differentiation for functions of two real variables. For other 
related theorems see Pierpont [2], page 265. 

Theorem 16. Let f{x, y) be a function of two real variables 
defined in a neighborhood N{aj 6), and suppose the partial deriva- 
tives fz, fyj CLndfxy exist and are finite inN{a, b) andfxy is continuous 
at (a, 6). Then the partial derivative fyx exists at (a, b) and equals 
fxvictj b). 

Proof— Let g{x, y) = f{x, y) - f{x, 6), and h(x, y) = [g{x, y) 
y)y{^ ““ (^)\y "" Then by applying the theorem of 
mean value tvdce, we find that there exists a point xi between 
a and x and a point yi between b and y such that 

k(x, y) = = Ux^, 2 /i). 

Hence, by the assumed continuity of /a® at (a, 6), 
lim h(x, y) = /^(a, h). 

a;«=o 
y = h 

Also from the definition of fyix^ h) we obtain 

lim h{x, y) = ~ ^) . 

y=h X a 


From this it easily follows that 


'c=a X a 


— fxy{o>j 5)- 


But the expression on the left is by definition the partial deriva- 
tive b). 

Theorem 17. Taylor’s theorem with remainder. Let the 
function f(x) be of class on the convex open set S, Then for 
every pair of points a and b in S there is a number to such that 
0 < to < 1 and 


m = m + d/(a; 6 - a) + dj(a; b - a, b ~ a)/2! 

+ * * * + d^^~'^'^f(a; b — a, ••• fb — a)f{m — 1)! 

+ d^”^'^f(a + toQ) — a); b — a, • • • , b — a)/ml 
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Proof. — ^The function f[a + t{b — a)] has a continuous mth 
derivative with respect to t on the closed interval [0, 1], by 
Theorem 15. Hence the theorem follows at once from Theorem 

6 . 

*3. Indeterminate Forms, — In this section we shall develop 
some theorems that justify the methods employed in elementary 
calculus for the evaluation of indeterminate forms. We are con- 
cerned only with single-real-valued functions of a single real 
variable. The first theorem is an extension of the Theorem of 
the Mean. 

Theokem 18. Suppose f(x) mid g{x) are continuous on the 
closed interval [a, 6] and have derivatives f and g' which are neither 
simultaneously zero nor simultaneously infinite on the open interval 
(a, 6). Suppose also that g{b) 9 ^ g{a). Then there is a point c 
between a and b such that g'{c) 9 ^ 0 and 

m -f(a) „ fjc) 
g(b) - gia) g\c) 

Proof. — ^Apply RoUe’s theorem to the function 
h{x) = fix) - f(a) - 

Theorem 19. Suppose f{x) and g{x) and their first m — 1 
derivatives are continuous on the closed interval [a, 6], and vanish 
at X — a. Suppose also that the mih derivatives and g^^^(x) 

exist and are not simultaneously infinite and g^”^^{x) 9 ^ 0 on the 
open interval fa, b). Then there is a point c between a and b such 
that 

m 

g{b) g^”^\c) 

Proof. — ^By the Theorem of the Mean (Theorem 4) it is seen 
that none of the derivatives g^”'~^^{x), . . . ,g\x)^ can vanish on 
the interval (a, b) . Then the desired result follows from Theorem 
18 by induction. The reader should note that it is not an essen- 
tial generalization of the theorem to assume only that the func- 
tions • • • j have limits equal to 

zero at the point a, without actually being defined there. For in 
that case we may set f{a) = g{a) = 0, and then the hypotheses 
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of the theorem as stated are all fulfilled, by Corollary 4 of 
Theorem 4. 

Theorem 20. In addition to the hypotheses of Theorem 18, 
suppose that f {a) = g{a) = 0. Let S be the subset of the open inter- 
val (a, b) on which g{x) 9 ^ 0, and let T be the subset on which 
g\x) 0 and f{x) is finite. Then every limiting value of the 
quotient f{x)lg{x) over a sequence (Xn) chosen from S and converging 
to a is also a limiting value of the quotient f{x)/g\x) over a sequence 
(Xn) chosen from T and converging to a. In particular^ if 
lim/(a;)/gr'(a;) = B over T, then ]imf(x)/g(x) ~ B over S. 

x=a x=a 

This follows at once from Theorem 18. A similar theorem on 
indeterminate forms follows from Theorem 19. However, most 
of the elementary problems involving the indetermmate form 0/0 
are solvable by repeated applications of Theorem 20. Another 
theorem which is sometimes useful is the following: 

Theorem 21. Let the function f and its first m — 2 derivatives 
f'j ... j 5^ continuous on the closed interval [a, 6]. Sup- 
pose also that the [m — l)st derivative exists and is finite on 
[a, 6], and exists, =f{a) « • • • =jf(«»-i)(a) 

= 0. Then 


lim 


f(a + h) _ f-Ka) 




ml 


If similar conditions hold for a function g, except that the integer m 
is replaced by n, and if and g^^^{a) are finite and not zero, 

then 

f(x) 

= ± 00 if n > m, 

= if n = m. 

When n ^ m, the requirement that f^^'^{a) 9 ^ 0 may be omitted. 
Proof . — By the definition of derivative, 


lim 

A=0 


f(m^i)(a + h) 
h 




Then from Theorem 19, with m replaced by m — 1, it follows that 

■^ f(a + h) _ + h) 

A«o a=q mlh ml 
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The final part of the theorem readily follows from the first part. 
Since 9^ 0, it follows that g{x) 5*^ 0 in a deleted neighbor- 

hood of a. 

The reader should note that the limits considered in Theorems 
20 and 21 are one-sided limits, so that they are more generally 
applicable than they would be if our consideration had been 
restricted to two-sided limits. However, the limiting value a 
of the variable x is supposed to be finite. The case when this 
limiting value is infinite is taken care of by the simple artifice 
indicated in the proof of the following theorem: 

Theorem 22. Suppose that f(x) and g{x) are continuous and 
have derivatives f{x) and g'{x) which are neither simultaneously 
zero nor simultaneously infinite on the open interval 6 < a; < + 00 . 
Suppose also that lim J{x) = lim g{x) = 0. Let the sets S 

X— + 00 a;s= -f- ao 

and T he defined as in Theorem 20. Then every limiting value of 
the quotient f{x)/g{x) over a sequence (xn) chosen from the set S and 
approaching + 00 is also a limiting value of the quotient f{x)/g'(x) 
over a sequence (xn) chosen from the set T and approaching + a> . 
In particular, if lim f(x)/g'{x) - B overTjthen lim f(x)/g(x) 

^ss-j-oo 

= B over S. 

Proof. — ^We may suppose that 6 > 0, so that the transforma- 
tion X = 1/y carries the interval 6 < x < -}■ into the interval 
0 <y < 1/6. Let h{y) = f(l/y), 6(0) = 0, k(y) = g{l/y), 6(0) 
= 0. Then the hypotheses of Theorem 20 are satisfied by the 
functions h and k on an interval 0 ^ y ^ c. 

In the next theorem the limiting value a of x may be either 
•finite or infinite. 

Theorem 23. Suppose that f(x) and g{x) are continuous and 
have derivatives f and g' which are neither simultaneously zero nor 
simultaneously infinite on the open interval (a, 6). Suppose also 
that lim |^(x)[ = +oo. Then every limiting value of the quotient 

x^a 

f(x)/g{x) over a sequence (xn) converging to a is also a limiting 
value of the quotient f{x)/g'{x) over a sequence (x^) converging to a 
and such that f(xn) is finite and g'{Xn) 9^ 0. In particular, if 
lim/'(x)/gr'(x) = B, then'&ocLf{x)/g(x) = B. 

x^a a 

Proof . — ^Let lim Xn = a, lim/(xn)/^(Xn) = L, lim Ch = a, where 

n n k 

Xn and Ck are in the open interval (a, b). Then for each k there 
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is an integer n* such that a < < Ck, and 


ficd 


giXnk) 






- g{Ck) 


- 1 


<i 


By Theorem 18, there is a point Xk between Xnj, and Ck such that 

ffe) _ fjXn.) -f(Ck) 

g'i^k) 


g{xnk) - g{ck) 

r kxm) f(ck) 

g(xm) 1 


j(Xnk) - fir(Cj:)J 


Hence ]imkf(xk)/g'ixk) = L, and obviously limft Xk - a. 


Exercises 

In each of the following examples, determine whether Theorem 
20 or 21, or neither, is applicable in evaluating ]imf{x)/g{x). 

x = 0 

1. f(x) - sin 1/x, g{x) = 6® — 1. 

2. /(x) = — 1, g(x) = X® sin 1/x + x®. 

3. /(x) == x^ sin 1/x — x^, g^(x) = 1 — cos^ x. 

4. /(x) = X® sin 1/x, g{x) == sin^ x. 

5. /(x) = — y - 1 - x^, 2 / = sin 1/x, gr(a;) = 6®' — 1. 
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CHAPTER VI 
THE RIEMAHN INTEGRAL 

1. Conditions for the Existence of the Integral. — The definition 
of a definite integral as the limit of a sum, as presented in ele- 
mentary calculus, was formulated by Riemann in the last century. 
This definition vnll be reviewed here, and necessary and sufficient 
conditions for the existence of the integral vdH be developed. 
Throughout this chapter we shall restrict attention to real-valued 
bounded functions f{x) whose domain is a finite closed interval 
[a, 6] in one-dimensional space. The functions considered need 
not be single-valued. 

Consider a partition P of the interval [a, 6] into closed sub- 
intervals It is understood that the intervals 1/ are nonover- 
lapping, that is, any pair of them have at most end points in 
common. Let A/ denote the length of Ij, and Xj a point of I,-, and 
let N{P) = greatest A/. Let 

siP) = 'ImAi- 

3 

The sum S is in. general a multiple-valued function, whether 
regarded as a function of P or of N{P). The bounded function 
f{x) is said to be Riemann-integrable or B-integrable in case 

lim S{P) 

exists. When it exists, this limit is denoted by the familiar 
symbol 

, dx. 

It is easy to see that the limit cannot exist and be finite when/(x) 
is unbounded. 

Let I/y == Lu.b. f{x) on Ij, Lj = g.Lb. f{x) on I/, 

S*{P) = y Ui As, & (P) = ^ Ls As. 

3 3 
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It may be shown in a similar way that there is a partition P% 
with N (Pi) < e, and a value of the sum SiPi) such that 

\f^ fix) dx - /S(P 2 )| < C/3. 

Then |/S(Pi) — S(P 2 )\ > C/3, and hence / is not integrable, by 
Theorem 3. 

The oscillation of a function / on a closed subinterval [c, d] 
of [a, 6], denoted by the symbol o[c, d], is defined to be the 
difference between the least upper bound and the greatest lower 
bound of fix) on the interval. The oscillation of / at a point x 
of [a, b], denoted by the symbol co(rc), is defined to be the differ- 
ence between the upper limit and the lower limit of / at the point 
X. It is easily seen that 

c^ix) = lim o[x — 5, a; + 8], 

5 = 0 

and that o[c, d] ^ c«j(a;) whenever the point x is interior to the 
interval [c, d]. Also / is continuous at a point if and only if co 
vanishes at that point. The next theorem is a generalization of 
the theorem on uniform continuity (Theorem 23 of Chap. IV). 

Theorem 5. If coix) < e on the interval [a, 6], there exists a 
number 5 > 0 such that o[c, d\ < e on every subinterval [c, d] of 
length less than 8. 

Proof, — ^For every x in [a, b] there exists a 5* > 0 such that 
o[x — 28xj X + 25j < €. By the Heine-Borel theorem, a finite 
subset of the family of intervals (x — 8a,j x + 8x) covers the 
interval [a, &]. The number 8 equal to the least of the numbers 
8x corresponding to this finite subset satisfies the conditions of 
the theorem. 

The exterior Jordan content of a point set E is the greatest 
lower bound of the sum of the lengths of a finite set of intervals 
covering E (in the sense of Sec. 6 of Chap. Ill), for all such 
coverings. The value obtained for the exterior content of a set 
E would be the same if the points of E were not required to be 
interior to the intervals. However, this requirement is a con- 
venient one for the proofs of the next two theorems. In case the 
exterior content of P is zero, we say simply that E has Jordan 
content zero. 

The exterior Lebesgue measure of a set E is defined in a 
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similar way, the only difference being that the covering set of 
intervals is permitted to be dennmerably infinite. This differ- 
ence makes the concept of Lebesgue measure much more useful 
than that of Jordan content. The theory of Lebesgue measure 
will be developed in detail in Chap. X. When the exterior 
measure of is zero, we say simply that E has Lebesgue measure 
zero. This is the only case we shall need to consider in the 
present chapter. 

The content and the measure of an interval are both equal 
to its length. It is easy to see that every subset of a set of 
measure (content) zero has measure (content) zero, and that 
the sum of a finite number of sets of measure (content) zero has 
measure (content) zero. The statement about sums extends to 
denumerably infinite sums for measure, but not for content. 
Thus a denumerable set has measure zero, although its exterior 
content may have any value whatever. For example, the set 
of rational points in the interval [a, 6] has exterior content 
(6 — a). However, the Cantor discontinuum (example F in 
Sec. 2, Chap. III)has content zero, although it is nondenumerable. 

Theoeem 6. Let Es = E[ca(x) ^ 5]. Thenf{x) is R-4ntegrable 
on [a, b] if and only if for every h > Othe set Es has Jordan content 
zero. 

Proof , — Suppose there is a number 5 > 0 such that the exterior 
content of Es is a number ij > 0. Then for every partition P 
the sum of the lengths of the intervals of P containing points of 
Es in their interiors is not less than rj. Hence S*{P) — S*(P) 
drj > 0, and by Theorems 2 and 4, f(x) cannot be integrable. 
To prove the converse, let 8 and be arbitrarily small positive 
numbers, and let IT be a set of intervals covering the set Es, with 
length sum less than By Theorem 5 the parts of the interval 
[a, b] not contained in the intervals of T may be subdivided into 
intervals on each of which the oscillation of / is less than 8, 
The partition P obtained by using the end points of the intervals 
Ik and the end points of the intervals of P as partition points is 
such that S*(P) - &(P) ^ {U - L)v + (5 - a)5, where L 
^ f{x) ^ U on [a, 6]. Hence the upper and lower integrals of 
f{x) are equal, and /(a;) is integrable, by Theorem 4. 

Theorem 7. A bounded function f{x) is B-4ntegrcMe on [a, b] 
if and only if the set D of points where f{x) is discontinuous has 
Lebesgue measure zero. 
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Proof ^ — ^To sho-^ that the condition is necessary, consider a 
sequence (5n) of positive numbers with limn 5n = 0. Then the 
set D is the sum of the sets Es^ as defined in Theorem 6. By 
Theorem 6, each Es^ is covered by a finite family of intervals 
with length sum^ < 7//2"*, where tj is an arbitrary positive number. 
Hence D is covered by a denumerable family with length sum < 
and therefore has Lebesgue measure zero. To show that the con- 
dition is suflBicient, let T be a denumerable family of intervals 
covering D and having length sum < tj, where is again arbi- 
trary. Every set Es is closed and contained in D. Hence by 
the Heine-Borel theorem a finite number of the intervals of the 
family T cover Es, so that Es has Jordan content zero. Thus 
f(x) is integrable by Theorem 6. 

2. The Fundamental Theorem of Integral Calculus. — We make 
the usual agreement that 

dx = - dx. 

In case the function / is i?-integrable on [a, b] and c is a point of 
[a, b], the function 

g(x) = ///W dx 

is called an indefinite integral of f{x). If f{x) and h(x) are 
single-valued functions defined on [a, b] and if h(x) has a deriva- 
tive and h^(x) = f(x) on [a, 6], then h(x) is called a primitive or 
antiderivative of fix'). A function f may be B-integrable without 
having an antiderivative, or vice versa. For example, let 
fix) = 0 fox X irrational, and/(p/g) = 1/g when p/q is a fraction 
in its lowest terms. Then / is continuous except for rational 
values of Xj and so is E-integrable on every interval, and its 
integral has the value zero. For an example of a function which 
has an antiderivative but is not B-integrable the reader may 
consult Hobson [1], page 490. 

Before stating the fundamental theorem, we shall list in 
Theorems 8 and 9 some elementary properties of the Riemann 
integral, which follow readily from its definition and from 
Theorem 7. 

Theokem 8. Suppose fix) and gix) are R-integrable on [a, 6]. 
Then 

1. fix) is R-integrable on every subinterval of [a, b]; 
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2. For every triple of points c, d, and e in [a, b], 

///(«) dx + Six) dx = Six) dx; 

3. If fix) is also R^integrahle on the interval [6, c], it is so on the 
extended interval [a, c\; 

4. fix) + gix) is R'integrahle, and 

ISi^) + dx = Six) dx + gix) dx; 

5. Six)gix) is R-integrable, and in particular cfix) isR-integrable 
for every real number c, and 

cfix) dx = e Six) dx; 

6. If Six) ^ gix) on [a, 6], 

j^fix) dx ^ gix) dx; 

7. \fix) 1 is R-^integrahle, and 

\j^ Six) &] g l/(a:)l dx. 

Theorem 9. Suppose fix) is R-integrahle on [a, 6], and let gix) 
he an indefinite integral of fix). Then 

1. \gixi) — gix 2 )\ ^ M\xi — X 2 \ for every xi and X 2 in [a, b], 
where M = l.u.b. |/(a;)| on [a, 6]; 

2. gix) is continuous on [a, 6]; 

3. If fix) is continuous, at a point c of [a, 6], then gix) has a 
derivative at c, and g'ic) = /(c). 

The proof is based on the relations 2, 6, and 7 of Theorem 8. 

Corollary. Every function continuous on an interval has an 
antiderivative on that interval. 

Theorem 10. Fundamental theorem of the integral calculus. 
Suppose fix) is R-integrdble on [a, b] and also has an antiderivative 
hix) on [a, b]. Then * 

hQ>) - h(a) = j^fix) dx. 

Proof . — Let P be an arbitrary partition of [a, b], with partition 
points au where a = ao < ai < • • • < On-i <«« = &. Then 
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n n 

A(6) — hia) - ^ [A(o:,) — A(af_i)] = ^ f(Xi)(<Xi — a£_i), 

i =5 1 i = 1 

where oji-i < Xi < ai, by the theorem of the mean for derivatives. 
But the last sum is one of the values of >S(P), and since 

lim S(P) 

NiP)=0 

exists, it has the value h{b) — h{a) as stated in the theorem. 

A simple example of a discontinuous function satisfying the 
conditions of the fundamental theorem is obtained by setting 
f{x) = 2x sin {1/x) — cos (1/a;) for x ^ 0, /(O) = 0. The func- 
tion h(x) — x^ sin (1/a;) with h(0) =0 is an antiderivative of 
f(x). A bounded function f{x) having only a finite number of 
discontinuities at which its right-hand and left-hand limits exist 
is alwrays JS-integrable but cannot have an antiderivative and so 
does not satisfy the conditions of the fundamental theorem. It 
does however have an antiderivative in a generalized sense, 
satisfying the conclusion of the theorem, and this suggests a 
generalization of the fundamental theoreni. A further generali- 
zation wiU be taken up in connection with the Lebesgue integral 
in a later chapter. We first state an immediate generalization 
of Theorem 9. 

^Theorem 11. Let fix) be bounded on [a, 6], and let 
«'«(«) = 

Then both the Junctions Quiz) and giix) have all the 'properties stated 
in Theorem 9. 

Since relations 2, 6, and 7 of Theorem 8 are applicable to the 
upper and lower integrals, the method of proving Theorem 9 is 
also applicable here. 

*Theobem 12. Let fix) be bounded on [a, 6], and let hix) be a 
continuous function such that for each x 

4>ix) g fix) ^ ^(a;), 

where 0(a;) a'nd ^ix) are two of the derivates of h. Then the 
upper R-integrals of fix) and of the four derivates of h are all 
equal, and the same holds true for the lower R-integrals, More-- 
over, the difference hQf) — hia) lies between the upper and lower 
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R-integrals of f{x) on [a, 6]. Hence in casef (or an arbitrary one 
of the derivates of h) is R-integrable, so are the remaining der-> 
ivates, and 

h(b) — h(a) = f(x) dx. 

Proof , — The upper i2-integral of f(x) is defined to be g.I.b, 
S*(P), where P is a partition of [a, b] into intervals [aj^i, ccj] 

S^(P) = ^ Uj Aj, A; = oj — and Uj = Lu.b. f(x) on the 

closed interval aj]. If F/ = Lu.b. f(x) on the open interval 
(ay-i, aj), then 

r*(P) s ^ g 5*(P). 

It is easy to see, however, that g.l.b. T*(P) == g.l.b, S*(P), so 
that it is immaterial whether we use open intervals or closed 
intervals in defining the upper and lower P-integrals. To prove 
this we may temporarily assume (as in the proof of Theorem 2) 
that f{x) ^ 0. Corresponding to an arbitrary e > 0, choose the 
partition P so that 

(2:1) T*(P) ^ g.Lb. T*iP) + e. 

Insert additional partition points to form a partition Pi, and 
let the sums over the intervals of Pi which have a point of P as 
an end point be denoted by S* (Pi), Tq{Pi), while the sums over 
the remaining intervals are denoted by ^i(Pi), ri(Pi). Since 
f is bounded, the partition Pi may be so chosen that S* (Pi) < e, 
and since /is nonnegative, we shall always have /S* (Pi) ^ T*(P). 
By combining these inequalities with (2:1) we find that S*(Pi) 
< g.l.b. !F*(P) + 2e and, since e is arbitrary, gJ.b. S*(P) == g.Lb. 
r*(P). 

To complete the proof of the theorem we note that by Corollary 
1 of Theorem 8 in Chap. V the bounds of the four derivates of 
h on the open interval (o!/_i, aj) are the same, and hence the same 
as the bounds of / on that interval. By Corollary 2 of the same 
theorem, h(aj) — h(aj^i) ^ F, A/, so that h(b) — h(a) ^ T*(P), 
and thus 

hQ>) - h(a) ^ f f(x) dx. 

The corresponding inequality for the lower integral follows from 
the above in the usual way by considering the negatives of h and/. 
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Exercise 

What is the solution of the following paradox? If 

= 1 + el/* 

and 

gl/a: 

/(^) = a;2(l -j- elA)“2 

then fix) ^ 0, h'ix) = fix), and so 

0 g dx = hi!) - hi~l) = < 0. 

3. Further Properties of the Integral. — More general theorems 
than some of the following can be proved even for the Riemann 
integral but, since corresponding theorems will be proved for the 
Lebesgue integral in a later chapter, we shall content ourselves 
in this section with theorems whose proofs are comparatively 
simple. The first two theorems are easily proved by means of 
Theorems 8 and 10. 

Theorem 13. Integration by parts. Suppose f(x) and g{x) 
have derivatives f{x) and g'{x) which are R-integrable on [a, &]. 
Then 

fii)gib) ~fia)gia) = fix)g'ix) dx + j^f'ix)gix) dx. 

Theorem 14. Integration by substitution. Suppose fix) is 
continuous on [a, d], and git) has a deriuative g'it) which is R-inte- 
grable on [c, d]. Suppose a g git) ^ b for t on [c, d], and let 
gie). = ai, gid) = bi. Then 

j^^fix) dx = f'mmg'it) dt. 

*When the function gif) is monotonic, the other requirements 
for the validity of the formula for change of variable may be 
lightened, as is indicated by the following theorem: 

*Theorem 15. Let f(x) be bounded on [a, 6], and suppose that 
g{t) is nondecreasing on [c, d] and that 0(^), one of the derivates of 
g{t), is R-^integrable on [c, d]. Let a = g{e), b = g{d). Then 
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J'j{x)dx = 

fix) dx = ff f[git)]4>it) dt. 

Hence if either of the Riemann integrals 

fix) dx, f\git)]<l>it) dt 

exists, so doesHhe other, and they have the same value. 

Proof, — ^Let M = l.u.b. |/(a;)l on [a, i], K = l.u.b. <l>(t) on 
[c, d]. Let P be a partition of [c, rf] into intervals Ij of length A/, 
and let P be the corresponding partition of [a, 6] determined by 
,the function g(t), with intervals Ij of length Aj, Some of the 
partition points of P may be coincident, and so some of the 
lengths Aj may be zero, but this ‘will not affect the validity of 
the argument. Let Uj = l.u.b. f{z) on Ij, Uj = l.u.b. f[g(t)]<f>(t) on 

Ij, Uj s l.u.b. <l>{t) on Ij, Ij = g.l.b. <l>{t) on Ij, S*{P) == ^ UjAj, 

S*(P) = ^ tfj Aj. Then since <t> is nowhere negative, Uj = Uj<rj 

where Ij ^ <ry ^ u,, and by Corollary 2 of Theorem 8 in Chap. V, 
Aj = Ajdj, where Ij ^ Bj g Uj. Hence 

15*(P) _ s*iP)\ = 12 - UiAi]\ = 2 U,-U<ri - ^)| 

^ m2 A,k- - Bil ^ m2 - W, 

and the last sum approaches zero with N(P) since 0 is P-inte- 
grable. Also JV(P) ^ KN{P), so that 

lim S*(P) = Pf(x) dx, 
mP)^o 

and hence the statement of the theorem about the upper integrals 
follows at once. The statement involving the lower integrals 
follows from that for the upper integrals with / replaced by 
Theorem 16. Taylor’s theorem with new form of remainder. 
Suppose f{x) has derivatives up to and including the one of order 
m on the closed interval [a, 6], and suppose the mth derivative 
f^\x) is R^ntegrable on [a, 6]. Then ' 
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/(&) = Sia) + (& - a)f (a) + • • • + 

+ jl (1 - + t{h - a)] dt. 

Proof , — ^For m = 1, the theorem follows from Theorems 15 and 
10. The proof is completed by induction and use of integration 
by parts. For other forms of the remainder, see Jordan [5], 
VoL I, pages 245^. 

Theoeem 17. If S is a convex open set in k~dimensional space, 
and f{x) is of class on S, then for every pair of points a and b 
in S, 

f(b) = f(a) + dfia; 6 - a) + • • • 

, b-a, ■■ •,b- ay 

(m-1)! 

+ f + t(b - a);b - a, • • • ,b - a] dt. 

Theorem 18. First Theorem of the Mean for integrals. 

Suppose that the functions g{x) and f{x)g{x) are both Rdntegrable 
on [a, 6], and that g(x) does not assume both positive and negative 
values on [a, 6]. Let L = g.l.b. f{x) on [a, b], U = Lu.b. f{x) on 
[a, 6]. Then 

J rh tb 

fi^)g(p^) dx^ II g(x) dx 

where L ^ p ^ V. If f(x) has a continuous antiderivative, then 
we may take ijl == f(xo), where a < Xo < b. 

Proof , — It is plainly suflSicient to consider the case when 
g(x) 0. ThenLgix) ^ f{x)g(x) ^ Vg(x), and hence 

L g{x) dx ^ j^f{x)g{x) dx ^ U g{x) dx. 

From this statement (3 :1) follows immediately. In case g{x) — Q 
at all its points of continuity, we have 

g(x) dx = 0, 

and the number n may be chosen arbitrarily. In the contrary 
case there is a number 5 > 0 and a subinterval [a, $] such that 
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g(x) > d on [aj S]. The function /(a:) must also be J?-integrable 
on [a, S]j and hence either /(a:) = L at all its points of continuity- 
in [oL, jS], or else there is a number e > 0 and a subinterval [ai, /Sj 
of [a, 01 such that f{x) > L + e on [ai, jSi]. In the latter case 

dx^L g(x) dx + e5(/Si - ai), 

and thus > L. Thus if p = L, we must have f(x) = ix at all 
its points of continuity at least in the interval W, i^]. A similar 
statement is true il fi = U, Finally, in case L < pL < U, the 
desired conclusion follows from Theorem 5 of Chap. V. 

Note that in the special case where g(x) is constant, the final 
statement of the theorem may be derived directly from the 
Theorem of the Mean for derivatives with the help of the funda- 
mental theorem of integral calculus. 

The Second Theorem of the Mean for integrals is proved in 
Chap. XI, Sec. 7. 
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since lim \f(x, y') — ^(x)| = 0, it follows that |/(x, y) — g{x)\ 

j/ = 6 

S « for all X in )S and y in iV(6). 

2. Interchange of Order in Repeated Limits. — When 

= g{x) 

y=b 

and lim g(x) == C exist, we may call this value C a repeated limit 

xz=a 

of f(x, y) and write 

lim lim /(x, y) — C. 

a;=a y — b 

When lim f{x, y) does not exist, we may use the notation 



^/(x, y) 

y — b 

for the multiple-valued function gix) having the two values 
lim sup fix, y) and lim inf fix, y), (and values in between if 

y^b y^b 

desired). Then when lim g(x) C exists, we may write 

x^a 

lim E f(x, y) ^ C 

x^a y—b 

and call this a generalized repeated limit 
The following fundamental theorem on interchange of order of 
repeated limits is frequently called the ''Moore theorem'' (or the 
Moore-Osgood theorem) . ^ Its proof is given following Theorem 
3, with indications of possible weakening of the hypotheses. 

Theorem 2. The Moore theorem. Suppose that the functions 
/(^j y)i ^iy) ciU real-finite-valued and that 

(2:1) lim /(a;, y) = h{y) on T, 

a;=a 

(2:2) lim/(x, y) = gix) uniformly on S. 

y<=b 

Then the limits 

y), limgr(x), lim %) 

« = a x^a y’=b 

y^b 

all exist and are equal and finite. 

^See E. H. Moore, “Lectures on Advanced Integral Calculus'* (Unpub- 
lished), University of Chicago, Autumn Quarter, 1900. Manuscript in 
University of Chicago library, worked out by Oswald Veblen. See also 
W. F. Osgood, Funhtionentheorief Vol. I, (1907), p, 519, for the special case 
of double sequences. 
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Theorem 3. Suppose that 

/fe y) = 0. 

x=‘a 

y-h 

Then the generalized repeated limits 

lim K S{x, y) , lim Em /(a:, y) 

a:=sa y — h y^h x=a 

also exist and are equal to C. 

Theorem 3 follows immediately from the definitions. 

For more general theorems, giving necessary and sufficient 
conditions for the existence and equality of the generalized 
repeated limits, see Hobson [1], VoL I, pages 409-414. 

Proof of Theorem 2. — We replace (2:2) by the weaker h 3 rpothesis 

(2:3) lim [/(x, y) - g{x)] = 0. 

»=a 

y^b 

Since 

(2:4) Em [fix, y) - gix)] = hiy) - Em ^{a:), 

a?®=a aj = a 

(2:5) Em [/(a;, y) — ^(a:)] = hiy) - Em gix), 

x^a x^a 

we find by Theorem 3 that 

lim h(y) = Em g(x) = ^ g(x), 

y=b x=a x=a 

and this with (2:3) gives the desired conclusion. 

We could also replace (2:1) by the weaker hypothesis that 

lim [Em /(a;, y) — ^mf{x, y)] = 0, 

y — b x — a x^a 

where the upper and lower limits are finite-valued functions, and 
still obtain the existence of lim /(a;, y). Then in the proof 

x^a 

y=6 

(2:4) and (2:5) would need to be replaced by inequalities obtained 
from Theorem 14 of Chap. IV. 

We include the followmg extension of the Moore theorem, 
since it is sometimes useful to know that uniformity with r^pect 
to a parameter is preserved for the limits occurring in that 
theorem. 
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Theorem 4. Suppose that the functions f{x, y, z)^ g(x, z)j and 
h{y, z) are all reahfinite~valued for x in S, y in T, and z in U, 
and that 

lim f{x, y, z) = h(yj z) uniformly on U for each y in T, 

x^a 

/(^7 2/j uniformly on SU, 

ys=b 

Then lim f{Xj y, z) = lim g{x, z) = lim h{y, 2 ) uniformly on XJ, 

x — a x=>a y = h 

2 / = 6 

Proof . — ^Let C(z) denote the common value of the three limits 
in the conclusion. If \f{x, y, z) — g{Xj z)\ < € for all t/ in iV(6), 
a; in jS, and zinU, and |/(x, y, z) — hiy, z)\ < efor all y in N(b)j x 
in a neighborhood Ny(a) depending on y, and z in U, then 
\h(y, z) — g(Xj z)\ < 2e for all 2 / in N(b), x in iVy(a), and 2 in ?7. 
Hence \h(y, z) — C(z)\ ^ 26 for all 2 / in N{b) and zinJJ. If we 
fix 2/1 in NQ)), we then find \g{x, z) -- C{z)\ < 46 for all rr in 
iVi(a) = Nyfa) and for all 2 : in C/, and finally |/(a;, y, z) — C( 2 ;)| 
< 56 for all a; in JV’i(a), y in NQf), and 2 in ?7. 

A function fix, y) is said to be continuous in y at 2 / = 6 uni- 
formly for x in aS in case 6 is a point of T, fix, b) is finitei and 
lim fix, y) = fix, b) uniformly for a? in 5. 

3/«6 

Theorem 5. Suppose fix, y) is continuous in y at y — b 
uniformly for x in S, and continuous in x at x ^ a for each y in T. 
Then fix, y) is continuous in ix, y) at (a, b). 

This follows immediately from Theorem 2. An example of a 
function that is continuous in x for each y and continuous in y 
for each x, but not continuous in ix, y) at (0, 0), is obtained by 
setting fix, y) = xy^/ix^ + y^) for ix, y) 9 ^ (0, 0), /(O, 0) = 0. 
In this example, f approaches zero along every ray through the 
origin. 

The next theorem is closely related to Theorem 5 and is also 
an immediate corollary of Theorem 2. The reader should note 
the special case when fix, y) is replaced by fnix), and 6 = + - 

Theorem 6. Suppose fix, y) is continuous in x at x — a 
for each y in T, and lim fix, y) = gix) uniformly on S, where gix) 

y^h 

has finite values. Then gix) is continuous at x = a. 

The next two theorems are concerned with interchange of 
order of linodt and integral, and of limit and derivative, respec- 
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lively. In them we shall suppose that the range S of the variable 
x is a closed interval [a, /3] of one-dimensional space. 

Theorem 7. Let f{x, y) he R-integrable on [a^ 0\ for each y in T, 
and suppose that lim f{x, y) = g{x) uniformly on [a, fi]. Then 

y-h 

g{x) is R~integrahle on [a, fi], and 

g{x) drc == lim f(x, y) dx. 

Proof. — Since f(Xj y) is bounded as a function of x for each y, 
it is easily seen that g{x) is also boimded. Now let (?/«) be a 
sequence of values chosen from T such that lim y^ = h. Let 

n= 00 

Dn be the set of discontinuities of the fimction f{x, y^, and D 
that of g{x). Then D is contained in the sum of the sets by 
Theorem 6. Each Dn has measure zero, by Theorem 7 of Chap. 
VI, and so is enclosable in a set of intervals the sum of whose 
lengths is less than €/2”. Thus D is enclosable in a set of intervals 
the sum of whose lengths is less than e, and so D also has measure 
zero. Hence g{x) is iZ-integrable, again by Theorem 7 of Chap. 
VI. By Theorem 8 of Chap. VI we have 

Iff U(x, y) - da;[ ^ (/3 - a) l.u.b. \f(x, y) - g(x)\ 

for a ^ X ^ 0, 

and from this and the hypothesis of uniform convergence the 
desired conclusion follows immediately. 

When the convergence is not uniform, the conclusion in 
Theorem 7 sometimes fails. For example, if the sequence (xi) 
is a denumeration of the rational numbers in the interval [a, /?], 
andfnixi) = 1 for i = 1, • * • , w, fn(x) = 0 for aU other values 
of X, then lim /n(x) is not iJ-integrable. However, if /»(x) = 1 

for a < X < a + l/n, fn{x) = 0 for aU other values of a:, then 
lim fn(x) = 0, and lim / fn(x) dx = 0. 

n= 00 n“» 00 

Theorem 8. Let f{x, y) have a finite partial derivative fj^x, y) 
for each y in T and x on [a, 0\. Let Xo be a point of [a, 0\ at which 
I™ fi^O} y) exists and is finite, and suppose that lim fx{x, y) = h(x) 

y^b y—h 

uniformly on [a, jS]. Then there exists the finite limit lim f(x, y) 

y^b 
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= g{x) uniformly on [a, fil, and g(x) has a derivative g'(x) = h(x) 
on [a, ; 8 j. 

Proof. — ^From the Cauchy condition, we have 

lim [/(a:o, yi) - /(xo, yt)] = 0, 

yi—h 

C 2 - 6 '\ 

^ ' lim [fx{x, 2/1) — /»(2:, 2/2)] = 0 uniformly on [a, / 3 J. 

2/1 = 6 

" 2/2 = 6 

Let c be an arbitrary point of [a, and set 


F{x, y) = 


y) - fjc, y) 

X — c 


for X. 7^ c. By applying the Theorem of the Mean to the func- 
tion/(a:, 2/1) — fix, 2/2), first on the interval from Xo to x, and then 
on the interval from c to x, we find 

fi^, yi) - fi^, Vi) = \fM yi) - yi)Kx - xo) 

( 2 : 7 ) + fixo, 2/1) - fixo, yi), 

Fix, 2/1) - Fix, yi) = fxix*, yi) - f„ix*, yi), 

where x and x* depend on x, yi, and yt. Thus from ( 2 : 6 ) and 
( 2 : 7 ) and the Cauchy condition, we obtain the first part of the 
conclusion, and also 

lim Fix, y) = ~ uniformly. 

ysaj) X C 

From this we obtain the desired result by use of Theorem 2 . 

The reader who is familiar with the theory of functions of a 
complex variable will recall that when x is a complex variable 
ranging over a region S of the complex plane, f(Xj y) has a deriva- 
tive y) for a; in >S and 2^ in T, and lim f{x, y) = g{x) uniformly 

y=6 

on Sj then g{x) must be analytic and lim/x(x, y) = g'{x) uni- 

2/=6 

formly on Si, where 81 is an arbitrary closed region interior 
to S. It is important to have clearly in mind the difference 
between this result and Theorem 8 . 

The next theorems are concerned with the continuity of func- 
tions defined by integrals depending on a parameter, and with 
formulas for the integrals and derivatives of such functions. 

Theorem 9. Suppose that f(Xj y) is integrable on a ^ x ^ P 
for each y in a set T, and that f(x, y) is continuous in y at y = b 
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uniformly for x on [a, /3]. Thm the function 
g{y, z, w) = 1“ fix, y) dx 

is continuous in (y, ZyW)aty = b for z and w in [a, |S]. 

Proof. — Since 

fj’fdx = l^fdx - j^dx, 
it is clearly sufficient to consider the function 
k(if, w) S fix, v) dx. 

If l/fe y) "" /(^> ^ € for a g a? ^ iS, then \h{y, w) — h(bj w)\ 

^ €\P — 0:1 by Theorem 8 of Chap. VI, so that hly, w) is continu- 
ous m y ait y = b uniformly for w on [a, fi]. By Theorem 9 of 
Chap. VI, h(yj w) is continuous in w for each y. Hence h is 
continuous in the two variables together, by Theorem 5. 

The next theorem, on interchange of order for iterated inte- 
grals, is a very special one. We restrict attention to this case 
here because we have not considered multiple Riemann integrals. 
A much more general theorem will be given in terms of Lebesgue 
integrals in Chap. XI. 

Theorem 10. Suppose fix, y) is continuous in (x, y) on 
a^x^P, y^y^8. Then 

j^Si^y y)dydx = fix, y) dx dy. 

Proof. — The function / is uniformly continuous, by Theorem 
23 of Chap. IV, and the two iterated integrals always exist, by 
Theorem 9, and Theorem 7 of Chap. VI. Let 17 be a positive 
number such that \fix, y) — /(re', y')\ < e for \x — re'] < 17, 
\y — y'\ < 17. Then if P* is a partition of [a, p] with intervals 
denoted by Axi, and Py is a partition of [y, 5] with intervals 
denoted by Ay^, and if ^(P*) < ??, V(Py) < V; we have 

1 ^ Vi) ^ ~ ^ 

g *(|8 - «)(s - r). 



106 


UNIFORM CONVERGENCE 


[Chap. VII 


By combining this result Tvith a similar one in which the roles of 
X and y are interchanged, we find that 

^ ~ X ^y ^1 - - od(s - y). 

j i 

From this the equality of the two integrals readily follows. 

Theorem 11. Suppose that f(x, y) and its partial derivative 
fy(x, y) are continuous in (x, y) on a ^ x S y ^ y ^ 8. Let 
g(y) and h(y) be defined and have finite derivatives at b, and let 
y <b < 8y a < gib) < jS, a < hQ)) < jS. Then the function 

^^y^ = y^ ^ 

has a derivative at 5, and 

Proof. — ^Let us set 

0{y, 2 , w) = y) dx. 

Then by the Theorem of the Mean, 


0{y, 2 , w) — 0(b, 2 , w) 
y — b 


- fvix, 


Cw 

= / {fAx, y{x)] - fy{x, b)} dx, 


where yix) lies between y and 6. By the uniform continuity of 
fyi^j y)i expression approaches zero with {y — b). Hence 
G has a partial derivative 

Gy{y, 2 , w) = jl fy{x, y) dx, 

since in the above argument, 6 may be any value between y and 
d, and Gy is continuous by Theorem 9. The partial derivative 
Gy, = /(to, y), and G. = —f(z, y), by Theorem 9 of Chap. VI, and 
these are continuous functions by h 3 rpothesis. Thus G has a 
total differential by Theorem 12 of Chap. V, and then F'(b) 
exists and has the value stated, by Theorem 13 of Chap. V, 
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Exercises 

1. Prove the following theorem: Let f(x) have a derivative 
f(x) which is continuous on [a, 6]. Then 

jiox uniformly on [a, 6], 


Discuss the existence of the following limits and of the associ- 
ated repeated limits: 
xy 


2. 

lim 

x^ 

y^O 

3. 

lim 

a? = eo 

eo 


4. lim (—1)*+*' -4 + '^ ^ where a > 1 and x and y 

a;= -{- 00 _a Or ^ 


are 


« 

restricted to positive integral values. 


3. Infinite Series. — If ^ a, is an infinite series of real numbers, 
let Sm denote the sum of the first m terms. The series ^ Ut is 


said to be convergent in case the corresponding sequence (s^) of 
partial sums has a finite limit. The series is said to be divergent 
in case lim Sm is infinite. In either case the stun of the series is 
by definition equal to lim Sm- When lim Sm does not exist, the 
series is said to be oscillatory. 

This section will be devoted to the theory of convergent series. 
However, divergent and oscillatory series have their uses and, to 
indicate the nature of those uses, some remarks will be included 
at the end of the section on methods of summation for oscillatory 
series, and on computation and the study of functions by the use 
of oscillatory or divergent series. 

It is clear that a series is, like a sequence, a function whose 
domain is the class of natural numbers. The difference lies in 
the operations that are, if possible, to be performed. In view 
of the above definition, every theorem concerned with infinite 
sequences and their limits can be translated into a corr^ponding 
theorem on infinite series. The selection of a subsequence from 
the sequence (sm) corresponds to a grouping of the terms of the^ 
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series ^ cu. When Km Sm exists, every subsequence has the same 

limit. Hence the grouping of terms in a convergent series cannot 
affect the value of the sum. But for each accumulation point c 
of the sequence (Sm) there is a method of grouping the terms of the 

series ^ ai to form a series ^ h whose sum is c. For example, the 

terms of the oscKlatory series where 0 % = (—1)^ can be 
grouped to obtain the sum —1 or the sum 0. 

A rearrangement of a series ^ a* is effected by a one-to-one 
transformation {ij) of the class aii of natural numbers into itself. 
The rearranged series may be denoted by ^ 6/, where = at,.. 

For example, a rearrangement of the series + i — t + 

... is obtained by taking first the first term with a negative 
sign, next the first 10 terms with positive sign, then the second 
term with negative sign, then the next 10^ terms with positive 
sign, then the third term with negative sign, then the next 10® 
terms with positive sign, and so on, with no terms omitted or 
repeated. In this case the original series converges wMle the 
rearranged series diverges to + co . 

A series ^ a* is said to converge unconditionally when every 
rearrangement of it converges and has the same sum. A series 
^ Oi is said to converge absolutely when ^ |ai| converges. 

Theorem 12. A necessary and sufficient condition for a series 
^ (k of nonnegative terms to converge is that the sequence of partial 
sums be hounded. 

An immediate corollary of this theorem is the comparison test 
for series of nonnegative terms. 

Theorem 13. If a series of nonnegative terms converges, it 
converges unconditionally. 

Proof . — ^Let ^ be a rearrangement of ^ Uf, and let ^ a* = B. 

Let tm denote the sum of the first m terms of the series ^ hi. 

Then m O * ^ Sp ^ S. Thus the sequence (Q is mono- 

tonic and bounded and has a limit T ^ S. In the same way it 
follows that aS g r. 

Theorem 14. Let ^Oi be a series that converges hut does not 
^converge absolutely. Let C he an arbitrary point of the interval 
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[— 00 , + Then there exists a rearrangeTnent ^ 6* of the series 
whose sum is C. 

Proof. — ^Let d = ([ail + ai)/2, di = (|ail — ai)/2. Then c* + di 
== \€ii\, Ci di = Ui. Since ^ Oi converges but ^ ja4 diverges, 
it follows that ^ d and ^ dU both diverge, although lim a»* 
= lim d = lim di = 0. Let Ut denote the sum of the first m 
terms of the rearrangement ^ h which is to be determined. 

Then we may select for the first ki terms of the series ^ h, the 

first ki nonnegative terms of the series ^ Oj, where f i is the mini- 
mum integer for which ijfc, > C if C is finite, > 1 if C = + « , 
and where /:i = lifC=— oo. For the next (^*2 — ki) terms of 

^ hij select the first (k 2 — negative terms of ^ dj where 

is the minimum integer greater than ki for which 4, < C if C is 
finite, 2ifC=-”Oo, and where k^ = ki-j- I iiC = +oo. 

For the next (ks — ^* 2 ) terms of ^ h, select the first (kz — k 2 ) 

nonnegative terms of ^ Oi not already used, where kz is the 
minimum integer greater than k 2 such that tk^ > (7 if C is finite, 
> 3 if C = + 00 , and where frs = ^^2 + 1 if C = — 00 . The 
rearrangement ^ bi is defined by the indefinite continuation of 
these alternate selections of positive and negative terms. When 
C is infinite, clearly ^ When C is finite and kj ^ m 

< i'j+i, \tm ^ C\ ^ |6a 4 and lim hkj = 0 since lim Oi = 0. 

Theorem 16. A series ^ Oi corwerges uncondition^y if and 
only if it converges absolutely. 

Proof. — Let ^ d and ^ di be the series introduced in the proof 
of Theorem 14. Then if ^ |ai| converges, ^ d and ^ di also 

converge, by the comparison test, and hence ^ Oi converges. 
The convergence is unconditional, by Theorem 13. An uncondi- 
tionally convergent series must conveige absolutely, by Theorem 
14. 

It follows from the preceding theorems that, when every 
rearrangement of a given series converges, they must all have 
the same sum. 
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We next take up some fxmdamental notions concerning series 
of functions. Let the functions Ui{x) be single-real-finite valued 

on the set /S. The series ^ Ui{x) is said to converge absolutely- 
uniformly on in case ^ \ui{x)\ converges uniformly on S. The 
series ^ Ui{x) is said to converge imconditionally-uniformly on S 
in case every rearrangement of ^ Ui{x) converges uniformly on S. 
Theorem 16. If ^ Ui{x) converges ahsolutely-uniformly on S, 

then ^ %ti(x) converges unconditionally-uniformly on S, and 
conversely. 

Proof , — Let ^ Vj(x) be a rearrangement of ^ Ui(x). By the 
Cauchy condition for uniform convergence (Theorem 1), 


p 

€ > 0 O : 3m p^m.rcinsO* ^ K*(^)l < €. 

For each m there is an integern such that the functions , 

are among the functions vi, , Vn^i in the rearrange- 
ment, and for each q there is an integer p such that the functions 
vij ... ,Vq axe among the functions ui, , Up. Then 


a p 

g^Ti.arin/SO* Vj(x) g ^ Wi(x)\ < 


Thus we have verified the Cauchy condition for the uniform con- 
vergence of the rearrangement ^ Vj(x). 

To prove the converse, let us suppose that the series ^ lwi(a;)| 
does not converge uniformly. Then by the Cauchy condition, 

(3:1) 36 > 0 m O ■ 3p = ^ • 3x.- I \ui{x)\ > e. 

X— m 


Let mi = 1, and let pi and Xi be the corresponding values of p 
and X given by (3:1). When m*, p*, and Xk have been deter- 
mined, let mjfc+i > pjfc, and let p^+i and XkJ^i be the corresponding 
values of p and x given by (3:1). We can now show how to 
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obtain a rearrangement 2^ Vi(x) which, does not converge nni^ 
formly, as follows. In the group of terms 

pk 

let us rearrange the terms so that those which are positive at 
Xk come first, and those which are negative at Zk come last. Let 
the sum of the first group be denoted by Ajf, and the sum of the 
second group by Then 


Pk Pk 

y Vi(xii) = At + Ak, y lui(a:i)| = At ~ Aj > ^, 

and hence either > e/2 or A* < —e/2. Thus by the Cauchy 
condition, ^ cannot converge uniformly. 

The next theorem gives a useful sufficient condition for abso- 
lute-uniform convergence. It is frequently called the “Weier- 
strass ilf-test.” It is an immediate coroUary of the Cauchy 
condition. 

Theorem 17. If the series ^ Mi comerges and if K*(x)[ ^ Mi 
for every x in S and every % then ^Ui{x) converges absolutely- 
uniformly on S, 

We shall now consider an example of a series that converges 
absolutely and uniformly but not absolutely-uniformly. Con- 
sequently, by Theorem 16, it may be rearranged to form a series 
that does not converge uniformly. Let 


Ui (x) = (—xy/i for 0 g X < 1, 
= 0 for X = 1, 


The series obviously converges absolutely. To show that it 
converges uniformly, we may use Abel's identity, which may be 
expressed as follows. Let 



i^p 
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where p ^ q* Then 


Bn 


— tpA.pp *4“ ^ >l)^i 


t = p + l 


fl-1 


^ ^l+l) ”1” 


To treat our example, set = (--l)Vi, U = x\ Then for 
0 g a; < 1 we have 


q «-”l 

I 2 Mi(a:)[ = \Bps\ = 1 2 Api(x‘ - x‘+^) + 

j_p i=p 

g ^ |Apil(a:’ - a;^+0 + l^pel*® 

i = p 

g < Mp, 

where Mp = l.u.b. \Api\ for i ^ p. Since ^ Oi converges, 

lim Mp = 0, and ^ •Ui(x) converges uniformly, by the Cauchy 
condition. To show that the series does not converge absolutely- 
uniformly, we note that, since T |ai| does not converge, 


pO- 32>P9- ^ |ci,| > 1, 

i=p 

and hence 

3x9- ^ K(a^)l > 1. 

For other examples see Hobson [1], VoL 2, page 119, example (7) ; 
Pierpont [2]; VoL 2, page 165. The proof given for the uniform 
convergence of the series in the example above may be generalized 
to give a useful criterion for uniform convergence of a series, as on 
page 117 of Hobson. 

The theorems on series may be extended to multiple series. 
We shall restrict ourselves here to a brief consideration of double 

1 See, for example, Hobson [1], Vol. 2, pp. 49-56; Pierpont [2], VoL 2, 
Chap. 4; Reid [8], Chap. 4, 
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series. Let the double series be denoted by ^ Oa, and let 

m n 

Smn ~ ^ ^ Clij* 


t=l J=1 


When the row series converge, we may let 


m 00 



By definition, a double series ^ is convergent in case 
lim Smn exists and is finite. The series is convergent by 

771 = 00 , 71 = 00 

rows in case the row series converge, and lim Smoo exists and is 

Trass eo 

finite. The definition for convergence by columns is analogous. 

Other definitions for convergence of double series have been 
used,^^^ but the one given above is the commonly accepted one. 
We may also consider convergence by rows and convergence by 
columns in the generalized sense corresponding to that given for 
repeated limits in Sec. 2. 

Theorem 18. A necessary and sufficient condition for a double 
series ^ a^ of nonnegative terms to converge is that the partial sums 
Smn cLre hounded. 

Proof . — If m <n, we have Smm ^ s«„ g s«n. The sequence 
(s„»), being monotonic, has a limit >S, which by the preceding 
inequalities is also the limit of the double sequence (Smn)> It is 
clear that S is finite if and only if (smn) is bounded. 

Theorem 19. If a double series ^ Oij is absolutely convergent, 

then the series 

1. Converges, 

2. Converges by rows, 

3. Converges by columns, 

4. Converges when arranged as a simple series in any order. 
Moreover, the sums so obtamed are all equal. 

Proof . — ^As indicated in the proof of Theorem 14, the given 
series may be represented as the difference of two series of non- 
negative terms, and each of these will be convergent when the 

1 See, for example, Jordan [4], VoL 1, Chap. Z, No. 316. 
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given series is absolutely convergent. Hence we may suppose 
(kj 0, and let S denote the sum of the series, ^ h an arrange- 
ment as a simple series, and 

a 

t«i 

Then Smn ^ Sj tq ^ Sj and from these inequalities the conclu- 
sions (2), (3), and (4) follow, by Theorem 12. Moreover, 
Smn ^ Smoo and Smn ^ tq q IS Sufficiently large. Hence lim Sm^o 
= Sj lim tq = S, 

Another criterion for the existence and equality of the sum, 
the sum by rows, and the sum by columns, of a double series 
may be obtained from Theorem 2. Other types of theorems may 
be found in the references at the end of the chapter. 

*There are several useful methods for assigning a value to an 

in&aite series which apply to some oscillatory series ^ a,- such 

as the one for which a,* = (— 1)^’. Perhaps the simplest of these 
is the method of arithmetic means. If (sm) is the sequence of 

partial sums of the series ^ and the associated sequence of 
arithmetic means 


m 



has a finite limit L, the series 2^ Oy is said to be summable (C, 1) or 
(Hj 1) to the value L. When the sequence of arithmetic means 
of the sequence (tm) has the limit L, the series ^ a,- is said to be 

summable (H, 2) to the value L. This use of successive applica- 
tions of the process of taking arithmetic means was developed 
by Holder. Cesaro suggested a different extension of the method 
of arithmetic means. It has since been proved that the methods 
of CesS.ro and of H51der give the same result. Several other 
methods of summation have been invented by other mathema- 
ticians. (See Hobson [1], Vol. II, Chap. 1; Knopp [7], Chap. 13; 
Fort [6], Chap. 17.) An essential requirement for the acceptabil- 
ity of a method of summation is that the value it associates 
with a convergent series shall be the ordinary sum of that series. 
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*The theory of summability has applications in connection 
ydth Fourier series. The Fourier series for a given function 
f(x) may fail to converge for some values of x, but under certain 
conditions th|e value of the function may still be recovered from 
the series by a suitable method of su mm ation. A similar state- 
ment holds for power series. The series 

I — X + — x^ + ■ • • 

converges to 1/(1 + rr) for —1 < a; < 1, and it is summable 
{C, 1) to the value of that function for rr = 1. This suggests the 

Abel method of summation. If ^ o,- is such that the correspond- 
ing power series ^ OjX^ converges for |xj < 1 to f{x)j and if the 

left-hand limit /(I — 0) exists and is finite, the series ^ is said 

to be summable (A) to the value /(I — 0). 

*Although convergent series are of predominant importance 
in mathematical theory, oscillatory and divergent series are fre- 
quently of practical use in computation. If a certain number of 
terms of a series are to be used to compute a function, some assur- 
ance is needed that the error committed lies within the required 
limits, but the convergence of the series is quite irrelevant. A 
convergent series may converge too slowly to be of practical use, 
or a convenient formula for the remainder may be unobtainable. 
A class of nonconvergent series which is also useful in mathe- 
matical theory, for example in studying the properties of func- 
tions defined by differential equations, is the class of asymptotic 

eo 

seiies.^^^ A series ) ajkor** is said to represent a function f{x) 
asymptotically on the positive end of the a;-axis in case 

li“i [f(^) 5n(a;)]:r” =0 for ?^ = 0, 1, 2, • • • , 

a:= + eo 

It 

where Sn(x) == T akX'~‘^, This definition may be generalized in 

various ways; in particular, by allowing the variable a; to be 
complex. 

1 See Knopp [7], Chap. 14; Fort [6], Chap. 18; Ince, Differential Equations, 
pp. 169jJ^.; Schlesinger, Einfuhrung in die Theorie der gewohrUicken Differ^- 
entialgleichungenj 3d Ed., 1922, pp. 257J^. 
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Exercise 

State the theorems corresponding to Theorems 1, 6, 7, and 8 
in terms of series. 

4. The Space of Continuous Functions. — Let >S be a set of 
points in S*-dimensional space, and let E denote the class of all 
real-valued functions / that are continuous on S. The class 
E is a linear set in the sense that it contains the sum of every 
pair of its elements and the product of each of its elements by an 
arbitrary real number. It also contains the product of every 
pair of its elements and is closed under two additional operations 
which we shall introduce. If fi and /2 are two functions, let 
/i V /2 denote the function whose value for each x is the greater 
of/i(a:) and/ 2 (a;), and let/i A fi denote the function whose value 
for each x is the lesser of fi(x) and fiix). The results of these 
two operations may be called 'logical sum^’ and “logical prod- 
uct,^’ respectively, following Daniell,^^^ or “join^^ and “meet’^ 
following a usage of lattice theory. The class S is easily seen to 
be closed under these operations. 

It is frequently desirable to extend the domain of a function / 
which is continuous on S, i.e., to determine a function g which is 
continuous on a set T including S and such that g{x) — f(x) on S. 
Such a function g will be called an extension of /to be continuous 
on T, 

A function defined for 0 < < «> is called a modulus of 

continuity of a function f(x) with domain S in case^^^ 

0 < i < 00 . a: in ^ . a;' in jS - ||x “ x'\\ ^ ^ O * [/(a?) ~ f(x')\ 

The least modulus of continuity, of f{x) is the function <^>o(0 
whose value for each t is the greatest lower bound of the values 
of such fimctions <l>(t). It is clear that the function <^>o(0 is 
nondecreasing and nonnegative. Moreover, f(x) is uniformly 

continuous on if and only if lim <^>o(0 = 0. 

t=o 

A function <l>(t) will be said to be concave ^in case the set of 
points of the (i, w)-plane for which <l> is defined and u ^ is a 

^See Annals of Mathematics, Vol. 19 (1918), p. 280. 

2 The notation l|a;|| for the norm or modulus of a point was introduced in 
See, 2 of Chap. V. 
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convex set. A concave function 4^(t) defined for ^ ^ 0 and having 
^(0) ^ 0 has the property that 

(4:1) 4>(ti + ^ 2 ) ^ <f>(ti) + <#)(fe). 

For, assuming for definiteness 0 < < fe, the point (ti + ^ 2 , 

+ ^ 2 )) must lie on or below the line joining the points 
(ti, and (^ 2 , ^(^ 2 )), and also on or below the line joining the 
points (0, 0) and (h, 0(^i)). Hence 

(fe ~ + ^2) ^ 

+ ^2) S (^1 + t 2 )<t>(tl). 

If we add these two inequalities and divide by ^ 2 , we obtain 
(4:1). It is easily seen that a concave function must be con- 
tinuous, and hence the restriction that 0 < < ^2 may be 

removed. 

In order to prove our theorem on extension, we shall make use 
of the following preliminary result. 

Theorem 20. Suppose that the function <t>Q(t) is defined for 
0 < ^ < C30 j that there exist constants c and d such that 0 g 0o(O 
S ct + d, and that lim <l>Q(t) = 0. Then there exists a function 

<j>{t) which is (a) concave^ Q>) not less than <f>^{t)j (c) such that 

lim ^{t) = 0. Such a function <}>{{) is automatically continuous 
t^o 

and nondecreasing. 

Proof — ^The set of points of the (t, w)-plane for which t > 0, 
u ^ at + his obviously a convex set. Consequently the product 
V of all such sets for which <^o(0 i at + bis convex. The upper 
boundary of V defines the desired function <f){t). It is clear that 
<l>o{t) ^ 4>{i) ^ ct +d. To verify (c), we note that 

€ >0 .0:35 >09:0 < t S 50* <#>o(j5) ^ €, 
€>0.5>0:3): 3(r > 0 9 : ^ > 5 • * ai + € > ci + d. 

Thus <t>(t) <ai + e, and so <l}(t) < 2€ if ^ ^ e/a. If ^ were not 
monotonic, it would become negative for large values of L 
Theorem 21. Suppose that Ike function f is uniformly con- 
tinuous on the set S. Th^n there exists an extension g of f to he 
continuous an ike whole finite portion of space. This extension is 
uniquely determined on the closure S of S, If ^(t) is a modulus of 
continuity of f which is concave and approaches zero wiik t^ 'Gnen 
the extension g may be required to have as a modulus of con^ 
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tinuity. If f is hounded, then the extension g may at the same time 
be required to have the same hounds as 

Proof, — Suppose first that / is bounded. Then its least modu- 
lus of continuity is bounded, so that by Theorem 20 it has a 
modulus of continuity <j>(t) which is concave and approaches zero 
with t, and hence is continuous and nondecreasing. Let<#>(0) = 0, 
and 

g(x) s Lu.b. U(y) - <^(1!^ “ y\\)] for yiaS. 

Then when rr is in f{y) — <l>(\\x — 2 /[l) g f(x), so that g(x) 
— f(x). The function g clearly has only finite values, and by 
Theorem 14 of Chap. IV, 

g(x) - g(x') ^ l.u.b. [<j>(\[x' - yl|) - <l>(\\x - 2/11)] for y in S. 
Now ll^;' — 2/11 ^ 1!^' — ^1! + 11^ — 2/ll> ^rid hence by (4:1), 
^(11^' - 2/11) ^ 4>{\W “ ^11) + ^(11^ “ 2/11), so that 

g{x) - g{x') ^ <j>(\\x' - x\\). 

Thus <f> is also a modulus of continuity for the extension g. It 
is clear that g has the same upper bound as /. Let gi be the 
function that is constant and equal to the lower bound of f, and 
let ^2 = ^ V ^ 1 . Then gz satisfies all the requirements and has 
the same bounds as /. 

In case / is unbounded, let us assume for simplicity of notation 
that S contains the origin, and set Kn = ^[11^11 S u], Sn = SKn- 
By the uniform continuity of / on S, 3m 9* <^>o(l/w^) ^ 1, where 
<f>o is the least modulus of continuity of /. Thus 

|/(a;)| g 1/(0) 1 + mn 

for X in Sn^ Now let fi denote the section of the function / whose 
domain is ^ 2 , and let gi denote the extension of fi which has the 
same bounds as/i, obtained by the method of the first part of the 
proof. When fn-^i(x) and g»-i(x) have been defined, let fn(x) 
= gri^iix) on iSTn-i + fn(x) - f(x) On Sn+ij and let gn(x) be the 
extension of /»(x). Now let g(x) = gnix) on Kn. Then g(x) is 
seen to have the required properties. The uniqueness of the 
extension on S follows from Theorem 18 of Chap. IV. 

If we may take <l>(t) = Kt^, where 0 < o: ^ 1, then / is said to 
satisfy a Holder condition (Lipschitz condition when a = 1). 

^ Compare McShane, “Extension of Range of Functions,” Bulletin of the 
American Mathematical Society, Vol. 40 (1934), pp. 837-842. 
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Thus our theorem shows that a function satisfying such a condi- 
tion has an extension that also satisfies it. Moreover, the proof 
in the last paragraph shows that a function / which is continuous 
on a closed set S has a continuous extension g to the whole of 
space. Such a function / need not be uniformly continuous on 
S, although it is so on every Sn. 

Let us return to the consideration of the class S of functions / 
continuous on S, and let us suppose hereafter that the set S is 
bounded and closed. Then we may define the norm of / by 
the formula 

11/11 = l.u.b. l/(z)l on S. 

This norm has two important properties, expressed by the follow- 
ing formulas, which hold for all functions / and ^ in S and all 
real numbers a, 

(4:2) ||a/l| = laHl/H, 

(4:3) llZ + dlSil/ll + IMI- 

For an easily discovered reason the last inequality is frequently 
called the “triangle inequality.’’ In terms of the norm the 
distance from f io g \b defined to be |[/ — ^1|. The e-neighbor- 
hood N(J] e) of a function /is defined to consist of all functions g 
such that 11/ — ^11 < €. Thus the class ® becomes a linear space, 
in which the notion of function of accumulation is defined in 
terms of neighborhoods m the usual way. Along with this are 
associated automatically the notions of derived set, closed set, 
open set, and so on. By Theorem 1 the space E is complete, in 
the sense that every Cauchy sequence m E has a limit in E. But 
not every bounded set of continuous functions has a function of 
accumulation, so that to obtain an analogue of the Weierstrass- 
Bolzano theorem we must introduce another condition. 

If jD is a subset of the space E, I> is said to be compact in case 
every infinite subset of D has at least one function of accumula- 
tion. According to this definition, all finite sets D are compact. 

The functions / of a set D are said to be equicontinuous at a 
point 6 of in case 

lim f{x) = /(6) uniformly for / in D. 

They are said to be equicontinuous on a subset T of S in case 
this relation holds for every point 6 of T, When T is bounded 
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and closed, it is easily shown by means of the Heiae-Borel 
theorem that then lim f{x) = f(b) uniformly for / in D and b in 

x=b 

T. It is also clear that when S is bounded and closed, the func- 
tions / are equicontinuous on /S if and only if they have a common 
modulus of continuity 4>i() which approaches zero with L 
We shall now find it useful to consider some conditions imply- 
ing uniformity of convergence. 

Theorem 22. Su'p'pose that the functions fm{x) are real-finite- 
valued for x in S and m = 1, 2, • • • , and that 

lim fm(x) = bmj lim fm(x) = c, 

x = a a; = a 

m= to 

where bm and c are also finite. Then limfm(x) = bm uniformly 

x = a 

with respect to m. 

Proof — ^By Theorem 3, lim bm ~ c, and thus 

m 

6>0O:3p.35 >0 9:?re>p.a;in N(a; S) O' 

\fm(x) — c\ < « . 16m — c| < 6 , 

and hence l/m(x) — 6m| < 2«. Also 

«>0.pO:3)S>0s:m^p.a:in N(a; /3) O ' \U(x) — bm\ 

<2e, 

so that when a: is in the smaller of the two neighborhoods iV’(a,' 0), 
S), l/m(a:) — 6ml < 2e for all m. 

Theorem 23. Suppose that the function f{x, y) is real-finite- 
valued for X in the dosed set S and y in T and suppose that 

lim f(x + h,y) = g(x) on S, 

h-O 

y^b 

where g(x) is finite. Then 

lim f(x + hj y) = g(x) uniformly on S. 

y^b 

Proof — Since we may take h = 0, we have lim/(a:, y) = g(x) 

y^b 

for each a; in Then by Theorem 3, g{x) is continuous on S 
and, if we set /(x, 6) = g{x), /(x, y) is continuous on the closed 
set for which x is in /S and y b, and so is uniformly continuous 
on that set. 
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Theorem 24. Suppose that the functions fm(x) continuous 
on /S /or m = 1, 2, • • • , and that lim fm{x) = g{x) uniformly on 

m 

S. Then the functions fm(x) are equicontinuous on S, 

Proof, — By the Moore theorem (Theorem 2), 

lim fm(x + A) = g{x) on S, 

in= w 

and then by Theorem 22, lim/»(x + A) = fn(x) uniformly with 

k = 0 

respect to m. 

Theorem 25. Suppose that the functions f mix) are equicontinu-- 
ous on the hounded closed set S and that the sequence (fm(x)) con- 
verges at each point of a set T whose closure f = S, Then the 
sequence (fm(x)) converges uniformly on S. 

Proof. — ^Let g(x) = lim fm(x) wherever the limit exists. By 

m= « 

the Moore theorem, the three limits 

lim /m(x + h), lim g(x + h), lim fmix), 

h=0 A*aO TO= 00 

m— w 

all exist and are finite and equal, where a; is in /S and x + h 
is restricted to be in the set T. Hence they also exist without 
this restriction. Then by Theorem 23 we obtain the desired 
conclusion. 

Another theorem ensuring u niform convergence is due to Dini. 
Theorem 26. Suppose that the functions fm{x) and g{x) are 
continuous on the hounded closed set S. Suppose also that the 
sequence fm(x) is monotonic for each x in S, and that ]mifm(x) 

m 

= g{x) on S. Then lim fm(x) = g{x) uniformly on S. 

m 

Proof . — It is sufficient to consider the case where g(x) = 0. 
For a fixed x, and € > 0, 

9- I/aCx)! g e, 

35 > 0 9 : ||A|1 < 5 O • l/sCa: + h)l ^ l/«(a;)l + «, 

and hence 


^ Q - Pll <50* \fm(x + A)j g 2€. 


Thus the hypotheses of Theorem 23 are fulfilled. 
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In both of the last two theorems, the variable m may be 
replaced by a more general variable, as is shovn by applying 
Theorem 13 of Chap. IV to the function 

F{y) = l.u.b. |/(x, y) — g{x)\ for x on S, 

The need in the last two theorems for the hypothesis that S is 
closed is shown by the foUoving examples: 

fm{x) = sin (1/a:), 0 < a: < l/nir, 

= 0, l/nir ^ a; < 1. 

From Theorem 24 we can easily derive a necessary condition 
that a subset B of the space E of functions continuous on the 
boimded closed set S shall be compact. 

Theorem 27. Suppose that B is a compact subset of E. Then 
the functions f in B are uniformly bounded and equicontinuous. 

Proof, — It is obvious that B must be bounded. Suppose the 
fimctions / are not equicontinuous at a point x of S. Then 

(4:4) Be > 0 m O * 3/« , 3hm r < l/m . 

\fm(x "4“ hm) ““ fm(x)\ ^ e. 

However, by hypothesis the sequence (fm) has a subsequence 
(fmf) which converges uniformly on Sj so that by Theorem 24 its 
functions are equicontinuous on S, But this contradicts (4:4). 

That the conditions given in the last theorem are also sufficient 
for compactness was proved by Ascoli. 

Theorem 28. Ascoli’s theorem. Suppose that the functions 
f of a subset B of ^ are uniformly bounded and equicontinuous 
on S, Then B is compact 

Proof. — Let T be a denumerable subset of S whose closure 
f = S, and let the points of T be denoted by Xi. The existence 
of such a set was proved in Theorem 9 of Chap. III. In case the 
set B is finite, it is compact by definition. If B is in fi nite, let 
(/n) be a sequence of distinct functions chosen from B. By the 
Weierstrass-Bolzano theorem the sequence (fn(xi)) has a finite 
point of accumulation which we shall denote by g(xi)j and there 
is a subsequence (f^^^) such that ]imf^n\^i) = g(xi). The 

n 

sequence (f^^\x 2 )) has a point of accumulation g(x 2 )f and there is a 
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subsequence (/S,®) of such that lim/jf’Cars) = gixs). Pro- 

n 

ceeding in this way, we obtain a sequence of values g(xi) and a 
sequence of subsequences such that ]imfn\^j) = for j ^ i, 

n 

The '^diagonal sequence” vdll be denoted by (F„). If the 
first i terms of (F^) are omitted, the remainder forms a subse- 
quence of so that lim Fn{xi) = g{x^) for f = 1, 2, 3, • • • , 

n 

that is, the sequence Fn(x) converges on T. Then by Theorem 
25, it converges uniformly on the whole of S. 

In the above proof of Ascoli’s theorem we used the property 
that every subset S of the A'-dimensional space 9? is separable, 
in the sense that there exists a denumerable subset T whose 
closure f 2) S. When >S = the set T may be chosen to 
consist of all the points with rational coordinates. The space S 
of continuous functions also has the property of being separable. 
This is a consequence of Theorem 29, due to W’‘eierstrass, on the 
approximation of a continuous function by polynomials. For the 
class of polynomials vith rational coefficients is denumerable, and 
every polynomial may be approximated uniformly on a bounded 
set S by polynomials with rational coefficients. 

Theorem 29. Weierstrass’ theorem. If f(x) is continuous on 
the hounded closed set Sj then there exists a sequence of 'polynomials 
Pn(x) converging to f{x) uniformly on S. 

Proof. — By a linear transformation of variables we may trans- 
form the set S into a set interior to the interval A consisting of 
the points x for which 0 ^ x^^ g 1, so we shall suppose that 5 
is interior to A, By Theorem 21 we may suppose that f(x) is 
actually defined and continuous on the whole interval A and 
has the same bounds on A as on S. We shall let M = Il/j| = l.u.b. 
|/(x)l on Aj and let <!>{{) be a modulus of continuity of / on A, 
which approaches zero with t For convenience in writing the 
integrals below, we set / = 0 at points outside the interval A. 
Let B denote the interval consisting of the points for which 
||a;ll i 1, and set 

k 

Qn(x) = n (1 - 

t = l 

— = f Q„(x) dx = f ‘ ’ f QnCx) dx^^^ * • * dx^”\ 

JB J -1 J -1 


(4:5) 
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(4:6) 


^»(^) — Fn j ^ 


f(z)Q„(z — x) dz. 


Then it is clear that Qn(x) ^ 0 on 5, that Pnix) is a polynomial, 
and that for a: in A we have lPn(a:)l ^ M and 


(4:7) 




fix + v)Q„iv) dv. 


Now let /Si s [aU a: 9 : |Ia:l| < i]. Then on the set B — St we have 
(4:8) lQ„(a:)l g (1 - py. 

Also if S = n~^, 

— ^f Qn(x)dx^ f (1 - l/n)‘”da: = [25(1 - l/n)”P, 

A^« J Ss J Sg 


SO that 

(4:9) iin ^ 

where c is a properly chosen constant. Now let a denote the 
miniinuni distance from the set S to the boundary of the interval 
A, and let t < a. Then, by referring to (4:5) and (4:7) to (4:9), 
we see that on the set S, 

lP»(a:) - fix)\ = iin\ fg [/(a: + ») - /(a:)]Q»(a) dv\ 

= jsi + *') ~ Si^)\Qniv) dv 

+ {\fix + v)l + I/(a:)l}Qn(t>) dv 

g 4>{t) + 2M(1 - t^ycnJ^'^ 

For an arbitrary € > 0, we may choose t so that <i>{t) < e, and 
then there is an index q such that for n > q, 

2M{1 - ^2)n^fc/2 < 

This completes the proof. 

For other methods of proof for this famous theorem of Weier- 
strass, see D. V. Widder, The Laplace Transform^ pages 162-153; 
also Hobson [1], Vol. 2, pages 228-234, 459-461, and references 
there. The proof given above is due to Landau.^^^ It may be 
^ RendiconU del Circolo Matermtica di Palermo, Vol. 25 (1908), p. 337. 
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shown that when the function / is of class on the interval A, 
the derivatives of the polynomials Pn(x) defined by (4:6), up to 
and including those of order p, vdll converge uniformly on S to 
the corresponding derivatives of 
The space S contains functions that fail at every point to have 
a derivative, finite or infinite. To show this we cite the following 
example, due to Weierstrass, of a fimction of a single variable. 
For a more elaborate discussion of nondifferentiable functions 
and for other examples, see Hobson [1], Vol. 2, pages 401^12. 
Let 0 < 6 < 1, and let be an odd integer such that 

(4:10) 6* > 1 + 3t/2. 

Then the series 


(4:11) f(x) = y cos (Ir^x) 

n — O 

converges uniformly and so defines a function / which is continu- 
ous for all X. We shall show that at every point the upper 
derivate of / on one side is + <» while the lower derivate on the 
other side has the value — oo . 

Let f(x) = $m(x) + rfn(x), where Sm(x) denotes the sum of the 
first m terms of the series (4:11), and let 

Sm = lsm(x + h) — Sm(x)]/h, Bm = lrm(.x + k) — rn,{x)]/h. 


Then by the theorem of mean value it follows readily that 


(4:12) 


^ irim- - 1 ] 

hk — 




Now to each x and m there corresponds an integer p such that 

\k^x — p| g 

Let q = k^x — p, A = (±1 ~ Then 

(4:13) \h\ < 3/2fr- 

and h may be either positive or negative. Now k^{x + h) 
= ± 1), and k is odd, so that for n ^ m, 

cos [k^(x + A)] = (— 1)^^ 

^ See la Vall4e Poussin, Cours (Tanalysej 2d Ed., Tome 2 (1912), pp. 126- 
137; Graves, AnnaU of MaihemaMcB, Vol. 42 (1941), pp. 281-292. 
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Also 

cos (k^x) = cos + g)] 

= cos cos {k'^~^g) 

= (—1)*’ cos {k”^^, 

so that 

00 

(4:14) Rm = ^ Hi + cos (A:”-^?)]. 

n = m 

Every term of the series on the right side of this expression is 
nonnegative and, since \q\ ^ i, the first term (corresponding to 
n == m) is not less than 5^. Thus by (4:14) and (4:13), 



> 


2{hk)^ 
3 ' 


and hence with the help of (4:12) 


By (4:10), the expression on the right tends to + oo with m, and 
by (4:13), h tends to zero. Since lf(x + h) — f(x)]/h = Sm + Rm, 
we see from (4:14) that if the integer p is odd for infinitely many 
values of m, then D+(a;) = +°o, D-{x) = — 00 , while if p 
is even for infinitely many values of m, then D+{x) = — oo, 
D^ix) = +°°> 

The series (4:11) in the above example is a series of analytic 
functions of x which converges uniformly for x on the real axis. 
An elementary theorem of the theory of functions of a complex 
variable tells us that if this series converged uniformly in a 
region of the complex plane having a piece of the real axis in its 
interior, it would define a function f(x) analytic in the interior 
of that region and hence having derivatives of all orders. 

*6. Discontinuous Fimctions.^ — It is interesting to note that 
certain discontinuous functions may be defined by means of 
rather simple formulas. For example, let 

sgn X = 1 for X > Oi 

= — 1 for a; < 0, 

= 0 for X = 0» 

^ Compare the remark following Theorem 8 in Sec, 2. 
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Then 

2 

sgn X = - lim tan~^ nx = lim tanli nx, 

n n 

Moreover the function 

(5:1) /(x) = a + (5 — a) lim sgn (sin^ mlrx) 

m 

has the Value a for x rational and the value h for x irrational. 

In 1899 Baire introduced an interesting classification of dis- 
continuous functions, which may be described as follows. 
Let the functions continuous on the set S constitute the class 0. 
A function which is the limit on S of a sequence of continuous 
functions but 'which is not itself continuous is said to belong to 
the class 1. A function which is the limit on /S of a sequence 
of functions of class less than a, but which is not itself of class 
less than a, is said to belong to the class a. When the set S is 
perfect and nonnull, it may be proved that there are functions of 
class a for each ordinal number a of the first or of the second 
class.^2^ For example, the function sgn a: is in the class 1, while 
the function f{x) defined by (5:1) for a 6 is in the class 
It may also be shown that there are functions not in any of the 
Baire classes.^^^ 

We shall now show that every semicontinuous function is in 
Baire’s class 1, and in fact may be approximated by a monotonic 
sequence of continuous functions. The theorem will be stated 
only for the case of lower semicontinuous functions. 

Theorem 30. Suppose that g(x) is lower semicontinuous on 
the set S, Then there exists a nondeareasing sequence of 

functions which are continuous on S, such that lim fm(x) == g(x) 

m 

on 8, When the function g(x) has a finite lower hound, the func- 
tions fm(x) may he required to he coniinuoue and the sequence to he 
nondecreasing on the whole space. 

Proof, — ^By definition of lower semicontinuity, g(x) has only 
finite values. We shall at first suppose that g(x) ^ L on S, 

^ See Baire, Legons sur lesf (motions discontinues, Paris, 1905. 

2 See la Vall^ Poussin, InUgrales de Lehesgue, Fonctions ensemble, Classes 
de Baire, pp, 145-151. 

® For a proof, see Hobson [1], pp, 264r-274, 276. 

^ See Sierpinski, Fmdamenta Mathematicae, Vol. 5 (1924), pp. 87-91- 
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where L is finite. Let 

U{x) = g.l.b. [g{z) + mix - z\\] for zmS. 

Then it follows at once that!/ ^ fm{x) g fm+i(x) everywhere, and 
fm{x) g g{x) on Sj so that the sequence {jm{x)) has a limit /(a;), 
and j{x) ^ g(x) on S, To show that is continuous, let x and 
y be distinct points of space. Then for a properly selected point 
2 in /Sj 

g{z) + m|la: - z|[ < U(x) + \\x - y\\, 
fm(y) ^ gie) + m\\y - z|l g g(z) + m{\\y - x\\ + \\x - 2 ||) 

< fm(x) + (m + l)|la: — y\\. 

Since x and y may be interchanged in this argument, it follows 
that 

l/m(a:) -U{y)\ < (m + I)]]® - y\\. 

Finally, we wish to show that ]imfm(x) = g(x) on S, There 
exists a point 2 m in 5 such that 
(5:2) g(zm) + m\\x - 2m|l < fm{x) + 1/m, 

and hence 

[[a; — 2m[l ^ /«»(^) ^ j 

^ ^ toCa:) + 1 - i], 

SO that lim 2m = x. Therefore 

m 

g{x) g lim inf g{z„) ^ lim f„{x) 

m= « m= 00 

by the lower semicontinuity of g and (5:2). But it was already 
known that lim Sm{x) ^ g{x) on S, 

m 

To care for the case when the function g is not bounded 
below, we make use of the transformation 

• -no- 5^. 

which is continuous and increasing and transforms the interval 
( — 00 , + 00 ) into ( — 1,1). Obviously the inverse transformation 
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t = T(v) is also continuous and increasing. If we set y(x) 
= Y\g{x)\ then — 1 < 7 ( 2 :) < 1 and 7 is lower semicontinuous, 
so that by the first part of the proof there exists a nondecreasing 
sequence (<t>m(x)) of continuous functions such that lim 4}m(x) 

m 

= y(x) on S. Obviously we may also suppose that —1 ^ 

< 1 everywhere. Now let ^ be a convergent series of 
numbers whose terms satisfy the conditions 0 < < 1 , 

and set 

^ m + <t>m) + C2(<^m+2 4>m+l) + * ' * - 

This series converges uniformly, since 0 ^ — <f>n ^ 2, and 

hence each i/m is continuous. Moreover <l>m^i/m ^ i/m+i ^ 7 
on S, and i/m{x) = <l>m(x) when i/mix) = 7 ( 2 ;), i/m(x) > <l>m{x) 
when i>mix) < 7 ( 2 ;), so that we always have —1 < i/m(x) < 1 on 
S. Then the transformed functions fm(x) = T[i/m(x)] are all 
continuous and approximate to the function g(x) in the required 
fashion. 

We shall next consider a theorem that has as a corollary a con- 
verse of the last theorem. 

Theorem 31. Let /(a;, y) have for its domain ike Cartesian 
product ST, and let 


u{x) = lim sup j{x, y) on S, 

y = h 

m(y) = lim y) on T, 

x = a 

where u(x) and m(y) have finite values. Suppose, furthermore, that 
one of these relations holds uniformly. Then 

lim sup m{y) ^ lim inf u{x), 

x^a 

Proof. — Consider the case where 

lim sup/(a;, y) = u{x) uniformly on 8. 


Let e > 0. Then 

(5:3) 33 > 0»: xm 8 . y in TN Q>; 5) • D -/(x, y) < u(x) + «, 
(5:4) yiaT :3y > 0»:xm8N(a;y) 0‘/(aJ,&) >^{y) — «• 
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Hence we find in succession, 

y in TN(b; 3) . a; in SN(a; t) O • m(y) < u(x) + 2e, 

(5:6) y in TN(b-, 5) O ■ in{y) ^ lim inf u{z) + 2e, 

x — a 

lim sup m{y) g lim inf u{x). 

y=b x=a 

It is clear that in the theorem and the proof so far, the roles of 
X and y may be interchanged. Then the case Avhen the uniform- 
ity holds for lim inf f{x, y) may be obtained from the case already 
considered by replacing / by — 

Theorem 31 has the following immediate corollaries. 

Theorem 32. Let the functions fm(x) have domain >S, and let 
the sequence fm{x) be nondecreasing and bounded for each x in S. 
Then 

lim lim inf fmix) ^ lim inf lim fm(x). 

m= w x=a x^a m** w 

Theorem 33. Let the functions fmix ) be lower semicontinuous 
on Sj and let lim fmix) = gix) on S, where gix) is finite. Suppose 

m — 80 

also that the sequence fmix) is nondecreasing or else that the con- 
vergence is xmiform on S. Then gix) is lower semicontinuous on S. 

There are of course similar corollaries involving nonincreasing 
sequences and upper semicontinuous fxmctions. 


Exercise 

This exercise provides a review of fundamental points in some 
of the preceding chapters. 

Make up correct definitions and theorems from the following, 
by choosing the expression to be defined or the hypothesis 
of the theorem from A to Z, and the definition or the conclusion 
of the theorem from 1 to 30; for example, A • = • 1; A . B 0*2; 
C 3. Note that none of the statements given as examples is 
correct. It is understood in the following that the functions 
involved are real-valued. As usual, [a, b] denotes a closed 
interval of the real axis, but the set S and the interval [a, 6] 
have no relation unless otherwise specified. . 


A. The ordered field has the 
Dedekind property. 

B. The point c is interior to 
the set S. 


1. € > 0 : D : 3?) in 5 3* ?> in 
Nic; e) .b 9^ c. 

2. A real number C9:.c^S: 
€>00*3& in>S?*6<c 
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C. The set 8 contains none of 
its accumulation points. 

D. The set S is the sum of the 
open sets 

E. The greatest leaver bound 
of a set 8 of real numbers. 

F. The set 5 = A + 5, where 
A and B are nonnuU and 
have no points in common, 
and A is closed. 

G. The set 8 is connected. 

H. The set S = 4 + ^, where 
A and B are nonnuU open 
sets and have no points in 
common. 

I. The linearly ordered set 0 
has the Dedekind property. 

J. The point c is an accumula- 
tion point of the set 8. 

K. lim f(x) exists and is 

finite, where f(x) is defined 
on 8. 

L. lim inf /(x) = — oo. 

x^c 

M. 8 is bounded and closed, 
and/(x) is continuous on 8. 

N. f(x) has a continuous de- 
rivative on the interval 
[a,&]. 

O. f(Xj y) has finite partial 
derivatives df/dx and 6// dy 
at the point (xi, j^i). 

P. fix) is continuous on the 
interval [a, &]. 

Q. fix) has an antiderivative 
on the interval [a, 6]. 

R. fia)<u<fib), 

S. fix) has only a denumer- 
able infinity of discontinui- 
ties on the interval [a, 6], 


[ 3. The set S is disconnected. 

4. Ail the points of 8 are 
isolated points. 

5. The point c is not an exte- 
rior point of the set 8. 

! 6. Every subset S of 12 which 
has a lower bound has a 
greatest lower bound. 

7. The ordered field is 
Archimedean. 

8. 3e>09-Nic;e) C S, 

9. The set is open. 

10. The set A contains a point 
of accumulation of the set 
B. 

11. € > 0 O : > 0 9: X in 

8Nic; 5) . x' in 8Nic; 8) 

O- |/(a:) -/(xOl < €. 

12. € > 0 O : 35 > 0 9: X in 
8 .x' m 8N (x; 5) O ‘ 
l/(^) -m\<e. 

13. There is a point Xo between 
a and h such that/(xo) = u. 

14. fix) is Riemann-integrable 
on [a, 6]. 

15. €>0O*3x in Nic; e) 
rf{x) > - 1/e. 

16. fix) has a maximum and 
a minunum on the set 8. 

17. hm /«(x) exists and is 

z=h 

n=s 00 

finite. 

00 

18. The series ^ l/« (x)[ con- 

n® 1 

verges uniformly for x m 

19. Urn ^(x) and lim lim/»{x) 

® = & n= « x=b 

exist and are equal. 
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T. j{x) is bounded on [a, 6]. 

U. For each n, fn{x) is continu- 
ous in X for xin S, 

V. For each n, fn(x) is continu- 
ous in X uniformly with re- 
spect to re in 

W. fn{x) converges to g{x) as 
n approaches oo , uniformly 
for xia S, 

X. fn{x) is continuous in x on 
S, uniformly with respect to 
n, 

Y. For each n, lim fn(x) exists 

a; = 6 

and is finite. 

Z. Every rearrangement of the 

eO 

series converges 

n* 1 

uniformly for a; in 5. 


20. If S is an interval [a, 6], 
and each fn(x) is Riemann- 
integrable on [a, f>], then 
g(x) is Riemann-integrable 
on [a, b]j and 

fh fb 

lim fn dx = g dx. 

00 

21. lim ^ fn(x) exists and is 
finite. 

22. gix) is continuous on S, 

23. fix, y) has a differential 
at ixi, yi), 

24. 3M 91 X m [a, b],x' in 
[a, 6] O- 1/(4 -/Ml ^ 
M\x — x^\. 

25. The sum of the series 
fnix) is continuous on 

n = l 

s. 

26. a: in 5^ . € > 0 : D : 35 > 0 
9:n.x' in SNix; 5)0* 

\fn(x') - /„(a:)l < 6. 

27. € > 0 :3p 9171 > p . X 

m>SO* 1/nW - gix)\ < €. 

28. € > 0 : D : 3p 9: m > p . 
n > p , X in S * 3 • 
\Uix) - Uix)\ < €. 

29. n . X in /S . € > 0 O : 35 
>0 91 x' in SN (x; 5) O * 
\fnix') - fnix)\ < €. 

30. n.€>0 O .’35>09:a;in 
S.x' in SNix; 5) O' 
i/n(x') -/nWl < €. 
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CHAPTER VIII 

FUNCTIONS DEFINED IMPLICITLY 


1, Introduction. — The need for theorems justifying the exist- 
ence and properties of functions defined implicitly by means of 
an equation or a system of equations is illustrated by the follow- 
ing examples in which the desired properties fail to hold. If 
g{x, 2/) = + 2/^ — then ^(0, 0) == 0, but the equation 

g(x, 2 /) == 0 has no real solution for y when x has a value different 
from zero and less than one. If g{x, 2/) == (2/ ““ — x^, we 

find that the equation g{Xj 2 /) = 0 has two real solutions for y 
when X is positive and none at all when x is negative. 

In Sec. 2 we shall give conditions justifying the existence and 
imiqueness of the solution y = (j>{x) of an equation or system 
of equations g{x, y) = 0, near a given initial solution such as the 
point (0, 0) in the above examples. The method of proof we 
shall use is an extension of Newton’s method for the solution of 
numerical equations, with a slight modification. If 2/0 is a first 
approximation to a root of the equation g{y) = 0, then under 
certain conditions a better approximation is given by the formula 


Vi = Vo- 


g(yo) 

g'ivoY 


and the sequence ( 2 /m), where 


( 1 : 1 ) 


2/m+l — ym 


gO/m) 

g'iyo)’ 


converges to a root of the equation. It is convenient to set 

(1:2) /(.) 


Then the formula (1 :1) becomes 2/m+i = /( 2 /m), and in terms of the 
function / the method becomes one of successive substitution. 
This method of successive substitution is very widely applicable, 
since it may also be used to show the existence of solutions of 
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differential equations, integral equations, and systems of equa- 
tions with infinitely many unknowns, and the variables in these 
cases may be either real or complex. However, other methods 
could be used equally well to obtain the theorems of the present 
chapter. When the variables are complex and the functions 
involved are all analytic, the theorems obtained by the method of 
successive substitution show that the solutions are also analytic 
functions. These solutions may therefore be expressed as power 
series whose coefficients may be determined by the usual formal 
methods without any need for a supplementary proof of converg- 
ence by the use of dominant series. 

Sections 3 and 4 contain theorems on the extent of the domain 
of definition of implicit functions, and Sec. 5 contains theorems 
in which neither a Lipschitz condition nor differentiability are 
assumed. 

2. Solutions Defined near an Initial Solution. — The first 
theorem we shall give is concerned with conditions under which 
the method of successive substitution yields a sequence converg- 
ing to a solution. In it the function / is supposed to have 
values in the same space as its argument y, and this space may 
have any finite number of dimensions. The points at infinity 
are omitted from space throughout this chapter. The notation 
[ji/ll of Chap. V, Sec. 2, is used for max 

Theorem 1. Let f(y) be defined on a neighborhood N(yo; a), 
and suppose there is a number K < 1 such that for every pair of 
points yi and 2/2 in Niyo; a), 

(2:1) ll/(2/i) - /(y2)ll ^ 

Suppose also fhxit 

(2:2) - yo\\ < (1 - K)a. 

Then there is a unique point y in the neighborhood N(yo; a) siu^ 
that y = f(y). 

Proof.— Let yi = f(yo), yw+i = /(s^m). Then 

(2:3) '^y^t yj\ g K\\ym - y^^i^ ^ Ki^lyi - yo|l, 

provided all the approximations up to ym lie in the neighborhood 
N (j/o; a) . But then we have 
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m m 

(2:4) l| 2 ^„+i - yo\\ g ^ ||2/i+i - 2/.-1I ^ hi - 2/o|I ^ 


i = 0 


i=0 




SO that 2/m+i lies in the neighborhood and may be used to define 
the next approximation. From (2:3) we see that the series 

^ (2/m+i — 2/m) is dominated by a geometric series which con- 
verges. Hence the sequence (i/m) converges to a limit y, which 
lies in N{yQ] a) by (2:4). Since / is continuous by (2:1), 
converges to /(?/), and so y = f(y). If there were another solu- 
tion y in Niyo'j a), we should have by (2:1), 

\\v - y\\ g K\\y - y\\ < \\y - y\\, 
which is impossible. 

A function satisfying (2:1) is said to satisfy a Lipschitz condi- 
tion with constant K. From the Theorem of the Mean it is 
clear that this condition is satisfied when each component of / 
has continuous first partial derivatives with respect to the k vari- 
ables y^^ each of which is not greater than K/k in absolute value 
for y on the neighborhood Niyo; a). 

In case the space of the variable y is one-dimensional, the 
solution of the equation y == f(y) corresponds to finding the 
point of intersection of the curve z — f(y) and the line z = y. 
Some of the possibilities that may occur are indicated in the 
accompanying figures. The line AC in Figs. 1 to 3 has slope K 
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and, in case the function f(y) has a derivative, the Lipschitz 
condition (2:1) in the theorem implies that the slope of z = f(y) 
is numerically not greater than K on the interv^al (i/o — a, po + a). 
This condition fails to hold in Fig. 4. The condition (2:2) of 
the theorem requires that the segment AB shall be less than CD. 

Note that in case a = +«?, the condition (2:2) may be 
omitted. 

The following examples illustrate possible determinations of 
the constants a and K in Theorem 1. 


A. y = — y^ + 0.1. Here we may take z/o == 0.1, a = 0.1, 

K = 0.4. 

B. y ^ cos y — 0.8. Here we may take z/o = 0, a = x/6, 
K = 0.5. 

C. y -- 2. Here we may take 2 / 0 = — 2, a = 1, iT = 1/e. 
2 / = i cos y. Here a = + 00 , K = i, and we may take 
yo arbitrarily. 


In case the function g{y) has a continuous second derivative, 
let M{d) denote the maximum of \g''{y)\/W{yi^)\ on the interval 
2/0 — d ^ 2 / = 2/0 + d. Suppose d can be so chosen that 


(2:5) 


I ^ 4M(d) < 


|g'(yo)l 

|g(go)l 


Then since/' ( 2 /) = 1 — g'(y)/g'(.yo) = (go — g)g"(F)/fl^(ge), where 
y lies between yo and y, the function / defined by (1:2) satisfies 
the conditions of Theorem 1 with a = l/2M(c0, K = i, and 
hence the sequence defined by (1:1) converges to a solution of the 
equation g(y) = 0. 
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If we modify example A to 
y 

we find that Theorem 1 is not applicable directly. However, 
conditions (2:5) are fulfilled by g(y) — y^ — y^ — y 3 with 
2/0 - 2, d = i, M(d) = ^, a = *. 

We are now prepared to prove what is properly called an 
“implicit function theorem.” In its statement, x and y are 
variables in spaces of one or more dimensions, and g(Xj 2/) is a 
function with values in the same space as its argument y. The 
symbol gy{x, y) then stands for the square matrix whose elements 
are the partial derivatives of the components of g with respect to 
the components of y. Similarly the symbol g:^(Xj y) also stands 
for a matrix of partial derivatives, but it need not be square. 
We shall use the usual notation of matrix theory for matrix 
multiplication, treating x, y, and g as matrices each consisting 
of one column. Thus, for example, the notation gy{yi — 2/2) 
stands for the matrix the elements of whose only column are 

h 

X If® ~ determinant of the matrix gy will be 

denoted by det gy. 

Theorem 2. Suppose that g(x, y) is of class on an open 
set W of xy-space, and that g(xoj 2/0) = 0 while det gy{xQ, yf) ^ 0 
at a point (xo, 2/0) of W, Then there exist neighborhoods N(xo; b) 
and N(yo; a) and a function <t)(x) defined on W(a;o; h) such that 
for every x in N{xq; 6), det gy{xj <j>{x)) 5^ 0, and <^(a;) is the only 
solution in the neighborhood N{y^; a) of the equation g(xj y) = 0. 
Moreover, <l>(x) is of class on N(xo; b). 

Proof , — For simplicity we shall first take up the case when 
both variables x and y lie in one-dimensional spaces. Let 


( 2 : 6 ) 


/(a;, y) = y - 


g(x, y) 
9v(.Xo, yo)' 


Then the equation y = f{x, y) has the same solutions as g{x, y) 
= 0. Also / has a partial derivative with respect to y which is 
continuous and vanishes at {xq, yo). Hence there exist positive 
numbers K, a, b, and c, with K < 1, such that for xia N(xo;h) 
and y, yi, y% in N{yQ] a), {x, y) is in W, and 
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(2:7) \gy(x, y)\ ^ c, 

/9.0X W, yi) - M 2/2)1 == \Jv{x, 2/2 + e{yi - 2/2))I!2/i - 2 / 2 I 
^ g i^ll/x - yl 

\f{x, 2 / 0 ) - 2 / 0 I < (1 - 

Thus the existence and uniqueness of the function 4i{x) follow 
from Theorem 1. We may show that 4>{x) is continuous without 
assuming the existence of the partial derivative For, with 
the help of the Theorem of the Mean, have 

(2:9) 0 = g{xi, 4>{x^) ~ g{x, 4>{x)) 

= g{xi, <i>{xi)) - g{xi, 4>{x)) + g{xi, 4>{x)) - g{x, ii>{x)) 
= ^ A<^) + g{xij <t>(x)) — gix, <p(x))j 

w^here A<t> = <l){xi) — ^(x) and 0 < ^ < 1. Since \gyix, y)\'^c 
> 0 and g{x, y) is continuous, <t>{x) is also continuous. If the 
partial derivative gs exists and is continuous, then from (2:9), 
writing Ao; for X\ — x, we have 

(2:10) 0 = gy(xij i}>(x) + d A^) A<j> + ga.(z + AXj <t>{x)) Ax. 


Hence A<j)/Ax has the limit 


( 2 : 11 ) 


<t>'(x) = - 


gz(x, <l>{x)) ^ 

gyix, <l>(x)y 


and 4>(x) is of class C'. If ^ is of class and <^> is of class 
then the right-hand side of (2:11) is of class by 

Theorem 15 of Chap. V, and hence ^ is of class C^”^K 
The meaning of the theorem for the case just considered may be 
visualized by considering the graph of the equation z == g(Xj y). 
When this graph intersects the xy-plsuie at a point (xq^ 2 / 0 ) 
where the tangent plane is not parallel to the 2 /-axis, then the 
graph intersects the a; 2 /-plane in a curve passing through (xq, 2 / 0 ) 
which defines 2 / as a single-valued function of x. 

Let us return now to the general case, and set^^^ 

■4 (a:, Vi, Vi) = gy(x, Vi + t{yi - y*)) dt. 

At points where the matrix A(x, t/i, 2 / 2 ) is nonsingular, let jB(x, 
Vh 2 / 2 ) denote its inverse or reciprocal. By Theorem 17 of 


^ In this fonnula involving the integration of a matrix, it is understood 
that each element of the matrix is integrated separately. 
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g{x, yi) — g{x, yi ) = A(x, yi, 2/2) (2/1 — 2/2). 

Then in the preceding proof let us replace formula (2:6) by 
y) = y - B(xo, 2 / 0 , yo)g(^, y) 

and make corresponding alterations in the remainder of the proof. 
Inequality (2:7) is replaced by 

(2:12) Idet A{x, y-i, y^\ ^ c, 

and 'we note that then the elements of the matrix B{x, y-i, y^ 
are continuous and bounded for x in N (xo ; b) and 2/1 and 2/2 in 
N(yo‘,a). Formula (2:8) is replaced by 

ii/fe yi) - 1/2)1! = \\yi - Vi 

- B(xo, yo, yo)A(x, yi, yi)(yi - yz)!! 

^ ^\\yi - ViW, 

and (2:9) is replaced by 

0 = A{xi, ^{x)) A<t> + g{xi, ^(a;)) - g{xi (t>(x)), 

from which we obtain 

(2:13) A<l> = ^{xi), (l>(x))[gixi, (i>(x)) - g(x, (f>{x))]. 

If we set 

C(xi, x,y) = gJix + f(xi - x), y) dt, 

we obtain 

(2:14) A4> = —B(xij ^(xi), <l>(x))C(xi, x, <l>(x)) Ax 

from (2:13), so that (2:11) is replaced by the matrix formula 

(2:15) 4>^{x) = -B{x, 4>{x), 4>{x))C{x, x, ^(x)). 

Since the elements of the matrix B are rational functions of the 
elements of A, with denominator bounded from zero by (2:12), 
the ailment that <l> is of class is completed as before. Note 
that formula (2:15) is equivalent to the system of equations 

gsix, <l>{x)) + gy(x, <i>{x))<l>a;{x) = 0. 

It is clear that the above proof proceeds on the basis of the 
fact that for each x near xo, 2/0 is a sufficiently close approxima- 
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tion to a solution for Theorem 1 to be applicable. Thus we see 
that it is not essential to have an exact initial solution (xo, yo)- 

In the following examples the variables x and y are both in 
one-dimensional space. In each case except G an initial solution 
corresponding to a; = 0 may be considered. 

E. g(x, y) = X- + y^ — 1 = 0. 

F. g(x, y) = x^ + y- = 0. 

G. g(x, 2/) = + 2 /" + 1 = 0. 

H. g(x, y) = sin^ y - x + cos^ y ^ I = 0. 

I- g(x, y) = y^ - X sin (1/x) = 0. 

J- g(^, ?/) = 2 /^ ~ rc sin (1/x) — 1 = 0. 

In these examples the question of the existence of a solution and 
its properties when it exists may be settled by elementary con- 
siderations. To some of them Theorem 2 is applicable, to others 
not- We recall that the proof of Theorem 2 shows that every- 
thing but the differentiability of the solution may be secured 
without the existence of the partial derivative gx- In the next 
three examples the existence and properties of the solution W’ould 
not be obvious without the help of Theorem 2. 

K. g(x, 2 /) = sin (x + 2 () - 6^^ + 1 = 0. 

L. g(Xj y) — sin (x + y) — + 1 + xy sin (1/x) = 0. 

M. g(x, y) = log (1 + X + ^) — tanh xy = 0. 

3. Maximal Sheets of Solutions. — It is sometimes desirable 
to have information about the extent to which a solution y = ^(x) 
of an equation ^(x, 2/) = 0 niay be continued. ‘ The theorems to 
be proved in this section are designed to give information of this 
type. In Theorem 3 we shall be considering equations g(x, y) =0 
of the same type as those considered in Theorem 2, but for its 
statement we shall need to define some additional concepts. 

A sheet of points in x 2 /-space is defined to be a connected set 
Wq of points w = (x, y) with finite coordinates such that, for 
every point 'U?© = (xq^ 2/o) of Tfo, there exists a neighborhood 
N(v)q; a) such that no two points of TFo in Niw^; a) have the 
same projection x; and for every in TFo and every a > 0, there 
is a neighborhood N{x^\ h) each of whose points x is the projec- 
tion of a point m of TFo in N(wo; It is clear that in a 

^ This definition of a sheet of points is somewhat more restrictive than 
the one introduced in Bliss [4], p. 22. It corresponds to his ^‘connected 
sheet consisting only of interior points.” 
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suflSciently small neighborhood of each of its points a sheet 
determines 2 ^ as a single-valued continuous function of x. Con- 
versely, if 2 / = 4>{x) is continuous on an open connected set, then 
its graph is a sheet. Furthermore, a sheet is necessarily arcwise 
connected. 

For example, in case x and y represent points in spaces of one 
dimension, a sheet of points according to the above definition 
corresponds to a single-valued continuous function y = f{x) 
defined on an open interv^al c < x < d. The set of points on the 
circle + 2 /^ = 1 is not a sheet, but removal of the points of 
intersection with the a;-axis divides the set into two sheets. In 
case the rc-space has two dimensions and the 2 /-space has one 
dimension, the helicoidal surface y = c tan~^ (xi/x^) is a sheet. 
The sphere x\+xl + y^ = 1, on the other hand, is not a sheet, 
but is di\fided into two sheets by removal of its intersection with 
the plane y = C. 

A botmdaiy point of a sheet TFo is a point not belonging to 
TFo, but every neighborhood of which contains points of TFo. 
This concept is not the same as that of boundary point of a set, 
since every point of a sheet is a boimdary point of the set of 
points composing the sheet. 

If the function g{x^ y) is defined and of class C' for (oj, y) in an 
open set TF, then a point w = {x, y) is called an ordinary point 
for g{x, y) in case 21 ? is in TF and the matrix gy{xj y) is nonsingular. 
All other points are called exceptional points. 

Theoeem 3. Let Wq = (xq, yo) be an ordinary poirit for g{x, y) 
and a solution of the equation 

g{x, y) = 0. 

Then there is a unique sheet Wo of solutions of this equation with 
the properties 

A. TFo contains w^; 

B. Every point of Wo is an ordinary point; 

C. The only finite boundary points of Wo are exceptional points. 

Proof . — The existence of a sheet TFi havipg properties A and B 
follows from Theorem 2. Let TFo be the logical sum of all such 
sheets TF 1. Then TFo is connected and is a set of solutions having 
properties A and B. Moreover, from property B and Theorem 2 
it follows that TFo is a sheet. Let wi = (xi^ yi) be a boundary 
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point of Tfo and an ordinary point for g(x, y). Since g is con- 
tinuous, g{xi, yi) = 0. Hence by Theorem 2, the sheet TFo could 
be extended to include the point wi, and properties A and B 
would still hold. This contradicts the definition of TFo, and 
consequently TFo has property C. To show that there is only 
one sheet having these properties, suppose another sheet W 2 
has the same properties. Then W 2 must be contained in Wq. 
If A = TFo — TF 2 is not null, we find that TF 2 A' = 0 by Theorem 
2, and ATFg = 0 by property B for TFo and property C for TF^. 
But this contradicts the connectedness of TFo. 

As an example, consider the equations 

yl-yl- = 0, 

2 j / i 2/2 — Xi = 0. 

The functional determinant is 


22/1 

22/2 


-22/2 

2yi 


= Hvl + vD, 


which equals zero only for yi = yz = 0, xi — xz — 0. There is 
only one maximal sheet of solutions, corresponding to the Rie- 
mann surface for the function y = ^s/x, where y = + %2, 

X xi + ix 2 - However, if in the consideration of the equation 
y^ — X = Qy X and y are restricted to real values, there are two 
maximal sheets of solutions, corresponding, respectively, to 
positive and to negative values of y, and the point (0, 0) is a 
boimdary point of each. For the equation 2/^ — 1 = 0, 

there are also two maximal sheets of solutions, having no finite 
boundary points, when x and y are restricted to real values. For 
another example, consider the equation 

x\ + xl + y^ — I - 0. 

The exceptional points are those for which y = 0. The maximal 
sheet of solutions through the point (0, 0, 1) is the upper hemi- 
sphere while the maximal sheet of solutions through (0, 0, — 1) is 
the lower hemisphere. 

A more general application of Theorem 3 is that to an equation 
of the form 


g{Xy y) = ao(rc)2/” + ai{x)y^-^ + • ' • + an{x) = 0, 
where the functions ai{x) are polynomials. If x and y are per- 
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mitted to be complex variables and the pol 3 aioimal g(Xj y) is 
irreducible, there is only one maximal sheet of solutions, and 
its only finite boundary points correspond to the solutions of 
the equation D{x) = 0, v'here D{x) is the discriminant of g{x, y) 
regarded as a pohmomial in y. One or more of the values of y 
becomes infinite at the points v’here a^ix) =0. A variety of 
situations may arise when x and y are restricted to be real, as 
has been indicated by some of the preceding examples. Let us 
suppose, for instance, that the coeflScients of g(x, y) are real, that 
the equation a^ix) D(x)= 0 has no real roots, and that there 
are exactly k distinct real solutions (xi, yi), (xi, 2 / 2 ), ... , 
(^ij yk)j corresponding to a particular initial value of x. Then, 
when X and y are restricted to be real, there are k maximal sheets 
of solutions each of which determines a single-valued function 
of X defined on the whole x-axis. A special example of this is 
afforded by the equation 

(x^ + l)z/3 - (x^ + 3 ) 2 ; + 1 = 0, 

which has three distinct real roots for each real value of x. Its 
graph consists of three curves which do not intersect. 

4. An Extended Implicit Function Theorem. — (Compare Bliss 
[4], pages 19-21 ; Bolza [5]). There are cases in which one wishes 
to apply an implicit function theorem when an initial curve of 
solutions is given. Such an occasion will arise in the next 
chapter, when we consider an embedding theorem for systems of 
differential equations that are not solved for the derivatives. 

Theorem 4. Lei W* be a bounded closed set in the xy-space 
with projection X* on the x-space, and suppose each point x in X* 
is the projection of only one point {x, y) in TF*. Suppose also 
that each point of W* is an ordinary point for g{x, y), and that 
g{x^ y) on TF*. Then there exist positive numbers a and b and 
a function <j>{x) such that 

(a) <l>{x) is of does C' on the neighborhood N{X*; b); 

(b) For every x in N{X*; b) the point {x, <j>(x)) is the unique solu- 
tion in the neighborhood a) of g{x, y) — 0. 

Proof . — We first show that there is a neighborhood iV(TF*; a) 
in which there do not exist two solutions with the same x. If 
not, there would exist distinct solutions (a;„, ^n), 2/1)? 

every neighborhood N(W*; ««) with a^ = 1/n, and the two 
sequences {x^j yn) and (a;», y'J would have a common accumula- 
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tion point {x, y) in TF*. But by Theorem 2 there is a neighbor- 
hood of (x, y) in which the solution is unique. To show that the 
solution 4>{x) is certainly defined on a neighborhood N{X*; b), 
we may apply the Heine-Borel theorem, since the projection X* 
is also bounded and closed. By Theorem 2 the solution (j> is 
defined and of class C' on a neighborhood iV(a:; c) of each point 
X of X*, but the value of c may vaiv’* with x. Since the family 
of neighborhoods N{x; c/2) covers X*, there is a finite subset 
N{xi; Ci/2), . . . , XCa;*; Ck/2), which also covers X*. Let b 
be the least of the positive numbers Ci/ 2, - . . , Ck/2. Then 
each point x in N(X*; 6) is in one of the neighborhoods X(x, ; Ci) 
where the solution <j) is surely defined. 

As a simple example, we may consider the equation 

y^ + X 1 X 2 -1 = 0 , 

where the variables are all regarded as real. Each maximal sheet 
of solutions is single-valued, and its projection is bounded by 
the hyperbola xix^ =1: As an initial set TF*, we may take a 
segment Ci ^ Xi ^ di, 0:2 = 0, 2 / == 1. The size of the neighbor- 
hoods N(X*; b) and N{W^; a) guaranteed by Theorem 4 obvi- 
ously depends on ci and di, and it is clear from this example why 
the set TF* in the theorem is assumed to be bounded and closed. 
Another example in which the properties are not obvious is 
afforded by the equation 

sin + 2 /) ~ + X 1 X 2 + 1 = 0, 

Tvith the initial set of solutions Ci ^ a;i g di, x^ ^ 0, y = —xu 
*The following extension of Theorem 4 is readily proved, 
again with the help of the Borel theorem: 

*Theorem 5. Suppose that g(Xj y) = 0 on the bounded closed 
set TF* in xy-space and that each point of TF* is an ordinary 
point for g. Then there is a finite number h of maximal sheets of 
solutions TFi, * * * , TFa such that TF* C TFi + • • • + TF*. 
Moreover^ for every positive number a there is a positive number b 
such that N(x; b) is contained in the projection of the pari of one 
of the maximal sheets TFi, • • • , TF* cardained in N(w; a) whenn 
ever w = (x, y) is a point of TF*. When TF* is also connected^ 
= 1 . 

*6, Implicit Function Theorems without Differentiability. — 
Theorem 1 was concerned with the existence and uniquen^ of a 
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fixed point or invariant point for a transformation f(y). The 
next theorem yields the existence of a fixed point (but not its 
uniqueness) on the basis of veaker conditions than those of 
Theorem 1. The proof is somewhat more complicated and 
involves some elementary concepts of topology . 

A simplex S in A'-dimensional space is determined by a 
set of A- + 1 vertices po, Pu • • • , Pt, which do not lie in a 
(k — l)-dimensional hyperplane, and S consists of all points 

k 

y = 2 CiPi, 

1 = 0 

k 

Ci^O, 2 = 1 - 

1*0 

When = 1, a simplex is a closed interval [po, pj. For A- = 2, a 
simplex consists of the points within and on a triangle. For Ar = 3, 
a simplex consists of the points within and on a tetrahedron. 

A side of /S is determined by choosing a subset of its vertices 
and consists of the points given by (5:1) for which certain of the 
Ci are kept equal to zero. A side will be denoted by its vertices, 
and the simplex S itself will be regarded as a side when con- 
venient. Thus when k = Z, the sides of a tetrahedron consist 
of its vertices, edges, faces, and the tetrahedron itself. 

Any point Q — ^ dipi of S, not a vertex, determines a simplicial 

partition of S into subsimplices T,*, where Tj has g as a vertex 
in place of p/. (When g is on a side of S not containing p/, the 
corresponding Tj is not present.) It is clear that a point belong- 
ing to a subsimplex Tj also belongs to S, To show that every 
point y oi S given by (5:1) belongs to some subshnplex T,*, let 

V = mini m uTn (ci/dt), and let Ui = a — vdi. Then vq + ^ lupi 

CiPi, ^^0, + = and at least one = 0. This 

subdividing process may be repeated as often as is desired, with 
the proviso that each new vertex q is to be used to subdivide 
each simplex to which it belongs. The result of a finite succession 
of such subdivisions wiU also be called a simplicial partition and 
will be denoted by tt. It is clear that the maximum diameter of 



(5:1) 

for w’hich 
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a subsimplex of 8 may be made arbitrarily small by choice of 
a suitable simplicial partition ir. 

For two-dimensional space, Fig. 1 illustrates a partition that 
is not simplicial because and are not vertices of every sub- 
simplex to which they belong, while a simplicial partition using 
the same vertices is given in Fig. 2. 

We shall be interested in the properties of a function /i(g) 
defined for every vertex g of a partition r of 8, taking only the 
values 0, 1, . . . , and such that whenever q lies on a side 




(Pio? Viv - • • j Pim) of Sj fx(q) hos ouc of the values io, ii, . . . , im- 
A subsimplex T in x is called a ju-simplex in case the set of values 
of iJL(q) for q ranging over the vertices of T is [0, 1, A 

(k — l)-dimensional side U of a subsimplex in x is called a 
M-side in case the set of values of fi{q) for q ranging over the 
vertices of 17 is [0, 1, • • • , A- — 1]. In Fig. 3 is shown a sim- 
plicial partition of a triangle 8, with vertices labeled with the 
values of a fimction /x(g), and with the single Ai-simplex present 
shown by the heavy line. There are two /z-sides, but only one 
of these lies on the boundary of 8. This figure illustrates some 
of the possibilities that must be considered in the proof of Lemma 
1 . 

Lemma 1. For every eimpUdal partition t of 8 the number of 
fi-dmplices is odd. 
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Proof . — The statement is easily seen to be true for one-dimen- 
sional space. Now- let p be the number of p-simpliees, let o- be 
the number of p-sides Ijung on the boundarj' of S, and let oc(T) 
be the number of p-sides of an arbitrary subsimplex T of ir. 


2 



If T is a p-simplex, a{T) = 1, irhile if T is not a p-simplex, 
a{T) =0 or 2. Hence 

p = ^ a(D (mod 2). 

X 

Since every /x-side appears once in this sum if it lies on the 
boundary of S, and tvice if it does not, we have also 

<r='2 a{T) (mod 2). 

X 

Since all p-sides on the boundary of S must lie on the side (po, 
Pi, . . . , Pit-i), it follows that, if the statement holds for 
{k — l)-dimensional space, it holds for ^-dimensional space. 

Lemma 2. Let Aq, Ai, Ah closed sets such that every 

mHiimensional side (pi„ p»i, . - . , Pi„) of the simplex S is con- 
tained in the sum Ai^ + + • * * + Ai„j /or m = 0, 1, • • • , 

l\ Then the sets Ai have a common point. 

Proof , — ^For an arbitrary integer n, there is a simplicial par- 
tition of S for which each subsimplex has diameter less than 
1/n, For each vertex q of t, there is a side (pio, p^„ . . . , pij 
of S of lowest dimension containing q. Then g is ia one of the 
sets Ai^, * ‘ ‘ , Ai^, say in Ai^. Then if we set /x(g) = % the 
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function ju has the properties required for Lemma 1, so that there 
is a M-simplex (qq, gj, . . . , g*) in tt, may suppose the 
notation for the vertices chosen so that ju(gf) = ij and thus qf 
is in the set Ai, The sequence (go) has a point of accumulation y, 
which is also a point of accumulation of each sequence (gf), since 
the diameter of (gS, gL • ‘ , Qk) is less than 1/72. So the point y 

is in each set Ax. 

Theorem 6. Suppose the function f on S to is continuous 
on the k-dimensional simplex S and transforms the boundary of S 
into part of S. Then there is a point y in S such that y = f{y). 
Proof . — If S has vertices po, Pi, , p*, every point y of the 
space R^ may be represented in the foim 

k k 

(5:2) 2/ = y Cx-Px, y Cx = 1, 

t = 0 


the points of S being characterized by the additional conditions 
a ^ 0. Moreover, the coefficients Ci are continuous functions 
of y, since the equations (5:2) have the determinant of the 
coefficients of the Ci different from zero when the points pi deter- 
mine a /r-dimensional simplex. Hence the equations 

h k 

f(.y) = ^ 2 c- = 1, 

z *= 0 1 = 0 


determine the as continuous functions of y. Thus if we let 
Ax denote the set of all points y for which ^ Ci, each set 
A» is closed. If p is a point of a side (pi„ px^, . . . , pj„), then 


m m 

y Ct,- = 1, and also \ c'- ^ 1 since c'i ^ 0 when is on the 

m k 

boundary of S, and m = k and ^ ^ = 1 when y is 


y=o »=o 


interior to S. Thus ^ g c*,. for at least one value of j, so that 
the sets A, satisfy the conditions of Lemma 2. A common point 

k k 

Ci = 



of all the sets At must have 4 = c*, since ^ 


Theorem 6 has an immediate extension to ti^ case when / 
is on a bounded closed set T to R^, and there exists a continuous 
function gonT + f(T) to B*, having a single-valued inverse, and 
such that g{T) is a simplex S, Extensions of the theorem to more 
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general metric spaces than 22* have been obtained by various 
vriters.^^^ Existence theorems for differential equations follow 
from such a fixed-point theorem for the space E of continuous 
functions.^2) There are also more complicated theorems on fixed 
points for continuous transformations of manifolds that are not 
topologically equivalent to a simplex. 

In case the transformation / in Theorem 6 depends also on a 
parameter x, the equation y = /(x, y) determines a function 
y = which may however be multiple-valued, so that noth- 
ing can be proved about its continuity. However, when the 
solution y = <#»(x) of an equation g{x, ?/) = 0 is known to be 
single-valued, its continuity may be proved under rather general 
conditions, given in the following theorem: 

Theorem 7. If the function g(x, y) is continuous on the 
hounded closed set W o in xy-space and if for each x in the hounded 
closed set S, y — 4>{x) is the unique solution of the equation g{x, y) 
= 0 having (x, y) in TFo, then <t> is continuous on S, 

Proof. — By the first condition in Theorem 25 of Chap. IV, 
the set of all solutions of ^(x, y) = 0, lying in IVo and having 
X in S, is bounded and closed. By the third condition of the 
same theorem, <h{x) is continuous. 

If, for example, / is continuous on a bounded closed set 
and has a single-valued inverse, then is also continuous. 
When S is one-dimensional and / is properly monotonic, is 
obviously single-valued. Examples, such as f{y) = 1/y for 
1 ^ /(O) = 0, or f(y) ^ y foT 0 < y < 1, /(-I) = 0, 

/(2) = 1, show that need not be continuous when S is not 
closed. 
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CHAPTER IX 

ORDINARY DIFFERENTIAL EQUATIONS 


1. Conditions Ensuring the Existence of Solutions. — In the 
following Ave shall let x denote the single real independent 
variable, and let y denote the dependent variables, of Tvhich 
there may be any finite number. Derivatives with respect to x 
wiU be denoted by accents. Thus a system of differential equa- 
tions involving only first derivatives may be wrritten in the form 

(1:1) F(x, y, t/) = 0. 

An equation or a system of equations involving derivatives of 
higher orders may ahvays be reduced to a system of the form (1 .T) 
by the introduction of new dependent variables. For example, 
consider the equation 

( 1 : 2 ) y" 

If w^e set yi = y, y 2 = 2/', equation (1:2) is equivalent to the 
system 

(1:3) yi === y 2 , 

2/2 == -«^2/i. 

We shall begia by considering systems of the form 

( 1 : 4 ) y'^S(x,y), 

in which the derivatives are expressed explicitly as fimctions 
of X and y. Here it is understood that the number of equations 
is the same as the number of dependent variables y which are to 
be determined as functions of x. If there is only one equation 
and one variable y, the equation (1 :4) may be pictured as attach- 
ing to each point in a region of the a: 2 /-plane a line whose slope 
is f{Xj y). The problem of solving the differential equation is 
that of finding a curve having as its tangent at each point the 
line attached to that point. The extension of this geometrical 
interpretation to more dimensions is immediate. 

161 



152 


ORDIXARY DIFFEREXTIAL EQUATIOXS [Chap. IX 


By a solution of (1 :4) -we shall mean a differentiable function 
y{x) defined on an (open or closed) interval (a, 6) and such that 
y'(x) =/(x, y(x)) identically on (a, 6). The set of all points 
(x^ y(x)) vith X on (a, b) is called the graph of the solution. 
There vrill in general be iafinitely many solutions. If we adjoin 
to the differential equation (1:4) initial conditions of the form 
2/(1) = n, then the solution on an interval (a, 6) containing ^ is 
uniquely determined, provided the function / has suitable prop- 
erties. The requirement that the solution shall satisfy the 
initial condition yU) = rj expressed geometrically by saying 
that the graph of the solution shall pass through the point (?, 77). 
We shall be interested in studying the properties of the solution 
as a function y(x, tj) of x and these initial values. The variables 
i and rj constitute a special choice of the constants of integration, 
convenient for theoretical purposes. In a sufficiently restricted 
domain the complete family of solutions is obtained with the 
value of J fixed. In the first theorem to be proved the domain 
of the function / is assumed to have a special shape. 

Theorem 1. Suppose that f(xj y) is continuous in x and that 
there exists a constant K such that 

(1:5) 11/(1, y) - f{x, 2/1) II g Kly - 2/i|| 

for all values of x, y^ and yi with a ^ x ^ i. Then there exists a 
unique family y{x, t}) of solutions of the differential equations 
(1:4), defined for all x and J on the interval [a, 6] and for all rj, and 
such that 

y{i, n) = V- 

Moreover j the functions y{x, ??) and y'(Xj rj) are continuous. 

Proof. — It is clear that / is continuous in x and y together, 
since by the Lipschitz condition (1 :5) it is continuous in y uni- 
formly with respect to x. Now define a sequence of functions 
by successive substitutions as follows: 

(1:6) , yo(x,^,r,) = n, 

Vm+iix, 1 , 77) = 17 + f(x, ym) dx, m = 0 , 1 , 2 , • • • . 

By Theorem 9 of Chap. VII, the functions ym(Xj 77) are continu- 
ous for X and { on [a, 6] and tj arbitrary. For each number N 
there exists a Q such that 

llj/i(«, l v) - yoix, 1, 17)11 g Q 



Sec. 1] 


EXISTENCE OF SOLUTIONS 


153 


on the region Rif consisting of all x and ^ on [a, 5] and all with 
jjiylj g N. Then it may be shown by use of the Lipschitz 
condition (1 :5) and induction that 

lym+l — Vml g QK”'\x — 

on Bs. Since the series ^ QK’^(b — a)”‘/ml converges, it follows 

from Theorem 17 of Chap. VII that the sequence (ym{x, v)) 
converges uniformly on Rn. Since N may be chosen arbitrarily 
lai^e, the limit y{x, rj) is defined for all values of tj and is a 
continuous function of its arguments, by Theorem 6 of Chap. VII. 
Also f(x, ym{x, I, ti)) converges uniformly to /(x, y{x, ij)) on 
Rif, and so by (1:6) and Theorem 7 of Chap. VII, 

y{x, f, j?) = i; + lim £*/(x, j/„(x, |, v)) dx 

( 1 : 7 ) a 

= V + fix, yix, I v)) dx. 

By Theorem 9 of Chap. VI we may differentiate (1 :7) to obtain 
(1:4), from which the continuity of y'(Xj i?) is obvious. The 
uniqueness of the solution may be proved by supposing there are 
two solutions y{x) and z(x) corresponding to the same initial 
values (?, 77 ). Then 

y = y + ji fi^> x = n + fix, 2 ) dx. 

Let P = max [[ 2 /( 0 ;) — z(x)\\ on [a, &]. Then by the Lipschitz 
condition (1:5), 

\\yix) - z{x)\\ ^ K // \\y -z\\dx^ PK\x - i\, 

and by induction we find that 

\\y(x) — z(x)\\ ^ PK”*^\x — 

for every m, so that y{x) = z{x). 

It is clear from the preceding proof that an arbitrary continu- 
ous fimction of (x, rj) may be taken as the ioitial approximation 
Voi^, v) hi place of the special choice indicated in (1 :6). When 
this method of approximation is being used for numerical compu- 
tation of a solution, a suitable choice of yaix) may save much 
labor. 

Before proceeding to an extension of Theorem 1, we consider 
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some examples. A most important class of equations to which 
Theorem 1 is applicable is the class of linear equations. We 
shall wTite a system of linear equations in the matrix notation 

(1:8) y' = A(x)y + c(x), 

where A is a square matrix of continuous functions of x, defined 
for X on the interval [a, &], c is a matrix of only one column whose 
elements have the same properties, and y and y' are like\\ise 
regarded as matrices having only one column. The maximum 
of the sum of the absolute values of the elements of A is effective 
as a Lipschitz constant K in Theorem 1, though it is not in general 
the smallest one. 

In the following examples, the conclusions of Theorem 1 are 
not all fulfilled. In each there is a single variable y, and the 
explicit solutions are easily obtained by elementary means. The 
square roots indicated are aU understood to be the positive 


roots. 




A. 

y' 

= 


B. 

y' 

= 

sin X, 

C. 

y' 

= (i- 

yO^. 

D. 

v' 

= (1 - 


E. 

V' 

= y-. 



In example A the right-hand side is defined only for ^ ^ 0, and 
fails to satisfy a Lipschitz condition on this domain. There are 
infinitely many continuous solutions proceeding to the right from 
any point on the x-axis, each composed of a piece of that axis 
and the right half of a parabola ^ = (x — c)^, but there is only 
one solution proceeding to the left from such a point. In 
example B the right-hand side is defined and continuous for all 
values of x and y, and the solution fails to be uniquely deter- 
mined either to the right or to the left if it ever becomes tangent 
to the a;-axis. Example C is somewhat similar to A. We note 
that distinct solutions can meet only at points where the Lip- 
schitz condition fails. In example D the right-hand side has a 
continuous derivative, and so a Lipschitz condition is satisfied in 
the domain between the lines y = ±1^ and there is a unique 
solution in the form 


_ X — c 

+ cYV^’ • 
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through each point beWeen these lines. None of these solutions 
ever reaches either of the lines y ^ ±1/ The conclusion of 
Theorem 1 holds with the restriction that shall lie in the strip 
bounded by the lines y = ±1, but this conclusion cannot be 
deduced from the fact that the hypotheses hold in this strip, as 
is shown by example E. Here the function t/- satisfies a Lip- 
schitz condition on every finite interval of the ^-axis, but each 
solution y = l/(c — x) has a discontinuity. According to 
Theorem 1 this could not happen if the right-hand side satisfied 
a Lipschitz condition on the whole g^-axis. 

The next two theorems are preliminary results useful in secur- 
ing the continuity in the initial values and parameters of the 
solutions described in Theorem 4, They also have applications 
in more general situations. 

Theorem 2. Suppose that y(x) and z{x) are continuous 
functions with piecewise continuous derivatives on the interval 
a ^ X ^ b. Suppose also that f(x, y) is continuous in x and 
satisfies a Lipschitz condition in y, with constant K, on a domain D 
containing the graphs of y(x) and z(x). Suppose finally that 

(1:9) \\y'{x) - z'{x) - f(x, y(x)) +f{x, z{x))\\ g e 

at the points of [a, 6] where y\x) and z^{x) exist and are continuous. 
Then for each { and x on the interval [a, 6], we have 

\\y{x) - z{x)\\ s _ i). 

Proof. — ^Let y{x) = y{x) — z{x). When a: < ^, we may use 
the substitution x = — m, so it is only necessary to consider the 
case %‘^x. Then with the help of the Lipschitz condition and 
(1 :9), we find that 

!lp(a:) - p(|)ll ^ K // !1p|I dx + 6(a: - Q, 

and so 

(1:10) IIp(z)|| g |ip(Qll + K {llpll dx. 

Let M = max l|p(aj)l| on [a, &], and assume that 

(1:11) lip(a:)|| ^ Mm + {llp(f)ll + {«*'*-*> “ 1} 

, MKHx - m 
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This holds for ra = 1, by (1:10), since — 1 ^ K{x — {). 

By substituting (1 :11) in (1 :10) and integrating, vre obtain (1 :11) 
Tritb n replaced by n + 1. By letting n approach infinity in 
(1:11), 'we obtain the desired conclusion. 

Theorem 3. Suppose that the functions y(x) and z(x) are 
of doss C on the interval a ^ x ^ b, and that the functions f{x, y) 
and g{x, y) are continuous on a domain D containing the graphs of 
y(x) and z(x). Suppose also that on D, f{x, y) satisfies aLipschitz 
condition in y, with constant K, and that 

!!/(a:, y(a:))ii ^ 

lf{x, z{x)) - g(x, z(a:))jj S e, 

2/'(a:) = fCx, y{x)), z'{x) = g{x, z{x)), 

on [a, 6]. Then for each |, |, and x on the interval [a, h], we have 
Mx) - z(x)l! ^ {!l 2 /(|) - z(?)I| + Mil - 

+ ^ -, 1 ). 

This theorem follows immediately from Theorem 2. From 
it we see at once that (granting the existence of the solutions) a 
solution of / = g(Xj y) T^ill be near a solution of t/' ~ y) 
t akin g the same initial values, provided g(x^ y) differs but little 
from f{x, y). Thus, for sufficiently small values of x, a solution 
of the equation y' — ^xy differs but little from the solution 
y = (taking the same initial value) of the equation y' = xy. 
Likewise for sufficiently small values of x, a solution of the equa- 
tion 2/' = with 2 /( 0 ) = 7} differs but little from the solution 
with the same initial value of the equation 

The next theorem is concerned with the maximal extent of a 
solution of a system of differential equations, with somewhat 
relaxed conditions on }{Xj y). It is convenient at this point to 
introduce parameters a in the differential equations. If R 
denotes a set in (x, y, a)-space, the notation Ra will be used to 
denote the section of R consisting of aU points (x, y) for which 
{x^ 2 /j ^) is in R, 

Theorem 4. Letf(xj y, a) be defined and continuous on an open 
set R in (re, y^ a)-space and suppose in addition that each point of R 
has a neighborhood on which f satisfies a Lipschitz condition (1 :5) 
with respect to y. Then for each (|, t}, a) in R there exists a unique 
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solution y{x, 17, a) of the differential equations 
(1:12) y'=fix,y,a), 

defined and continuous for all x on an open interval (a(J, 77, a), 
V} graph lies in the section Ra of R, passes through 

(?? ri)} its finite limiting pointSj as x approaches a(g, a) 

or &(|, rj, a), on the boundary of Ra. Moreover^ the solution 
y{x, rjf «) continuous in all its arguments. 

Proof , — Let I be an interval in R, vdih edges parallel to the 
coordinate axes, on which/ satisfies a urdform Lipschitz condition. 
Then by Theorem 21 of Chap. VII, there exists a fimction g(x, 
y, a), defined for the same interval of values of x and a and for all 
y, satisfying the same Lipschitz condition, and equal to / on 
This function g is easily seen to be continuous. Thus by Theo- 
rem 1 the differential equations z' = g(x, z, a) have a unique 
solution z(x, 7j, a)j which is continuous in all its arguments by 
Theorem 3. If (?, 17, a) is interior to the interval /, the portion 
of this solution which lies interior to I will be denoted by y(Xj 77, 
a). It is a solution of the original differential equation (1:12) 
defined on an interval ai(J, 77, a) < a; < &i(g, 77, a), and extending 
from boundary to boundary of I. Now let (a(J, 77, a), &(^, 7?, a)) 
be the logical sum of all intervals containing f on w^hich a solu- 
tion y{Xj f, 77, a) is defined, lies in Raj passes through (^, 77), and 
is continuous in all its arguments. Clearly the solution is 
uniquely determined on the interval (a(^, rj, a), b{^, 77, a)), since 
a Lipschitz condition holds near each point on the graph. If 
(xnj yn) is a sequence of points on the graph such that hm Xn — a 

n— » 

= a(f, 77, a)j lim = w, we can show by an indirect proof that 

n= 08 

the point (a, u) is on the boimdary of iJa. For if (a, u) is in Ra, 
then there is a neighborhood N(a, u, oc; c) whose closure is con- 
tained in R and on which /(x, y, ot) satisfies a Lipschitz condition 
with respect to y. Let M = l.u.b. l|/(a;, y, a') II for (^7 Vt fo 
iV(a, Uj a] e), and suppose 5 < + 1). T^en (a:*, y») is in 

N{a,u;b), the solution y{x, a), which passes through y^)^ 
must satisfy 

1 For extension of the domain of /from an iaterval a simpler method than 
that of Theorem 21 may be employed. For example, if there is only one 
component of y, and the interval I is defined by a ^ a; ^ 6, c ^ y ^ d, we 
may set g{x, y) =* /(a;, c) for y < c, g(x, y) = /(a;, d) for y > d. 
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^ - u' g \!y - 2 /n^; + !i 2 /« — ^ 3/|a: — + 5 

^ {2M + 1)5 < 6 

for a — j5 ^ a: ^ Xny and since that solution extends from bound- 
ary to boundary^ of iV(a, u\ e) it must be defined for a — 5 g a: 
< 5. The solution y(Xj £ % ci) is also continuous in all its 
arguments on the extended inten-al a — 5 ^ a; < 6 , since 
Vn = S, Vi ol) is continuous in v, ct) for fixed, and 
y{^i Xn, Vn: oc) is continuous in (x, y^ ol). Thus we have obtained 
a contradiction vith the dej&nition of the interval (a(f, ri, a), 
Vj ol)), so that the point (a, u) cannot be in 
The hypotheses of Theorem 4 are clearly fulfiilled in case 
J(x, y, a) and the partial derivatives /y (a:, y, a) are continuous on 
R. Consequently, Theorem 4 is applicable in the examples A to 
E listed above, pro\dded the region R is suitably restricted. In 
example A, for instance, we would suppose y > 0. In example 
D, the domain of the function / may be extended by setting 
/ = 0 for \y\ > 1 , and then the hypotheses of Theorem 1 are 
satisfied. That a solution may have infinitely many Hmiting 
values on the boundary of the region R is shown by the example 

' 2 /' = 2 ^(cos log x)/x, 

■whose general solution is 

y = 

However, when /(x, y) is continuous on R plus its boundary, 
there cannot be more than one finite limiting point at either 
end of the interval (a, 6 ). 

The method of successive substitutions may be used to prove 
that, when the functions of the set denoted by /(x, y) are all 
analytic functions of their arguments, then the solutions of the 
differential equations (1:4) are analytic functions. For this 
purpose the variables must be regarded as complex variables, and 
care must be taken to restrict the independent variable x to a 
neighborhood of ^ so small that the successive approximations 
Vfn{x, 17 ) all lie in the domain where the functions /(x, y) are 
analytic. The line of development explicitly outlined in Theo- 
rems 1 and 4 is not applicable. The reader may consult Picard 
[ 8 ], pages 379-381. 

*When the function /(x, y) is only assumed to be continuous 
on the open set R, we may prove the existence (though not the 
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uniqueness) of a solution through each point of E, extending 
from boundary to boundary of Rj with the help of the preceding 
theorems and some theorems from Chap. VII, as follows: 

*Theorem 6 . Let f{x, y) be continuous on an open set R in 
(Xj y)-space. Then through each point (f, tj) in R there passes at 
least one solution y{x) of the differential equation y' = /(x, y), 
which is defined and continuous on an open interval (a, 6), has its 
graph in R, and has all its finite limiting points^ as x approaches 
a or b, on the boundary of R. 

Proof , — Consider an interval I contained in R, defined by 
inequalities of the form |a: — ^1 ^ Ai, jjy — t?!} g h^, and let 
M = Lu.b. Wfix, y)|! on I. By Theorem 29 of Chap. YII, there 
is a sequence (Pn) of polynomials such that jlPu(:r, y) — /(x, y)\\ 
approaches zero uniformly on 7 , and !|Pn(x, 2/)ij g M on 7 . By 
Theorem 4 , there is a unique solution yn{x) of the equation 
y' = Pn(x, y), passing through the point (^, 17). This solution 
lies in the interval 7 at least for jx — ^ hj where h is the smaller 
of hi and h2/M. The functions y^ix) are bounded and have 
bounded derivatives for |x — ^ A, and so they are equicon- 

tinuous. Hence by Theorem 28 of Chap. VII, there is a subse- 
quence (yn) which converges uniformly on the interval \x — 

^ A to a function y{x). Then vdth the help of an elementary 
inequality (or from Theorem 4 of Chap. VII) it follows that 
= Pn.(Xj ynfx)) converges uniformly to /(x, y(x))j and 
so y{x) has a derivative y'{x) = /(x, yix)) for [x — ^ h, by 

Theorem 8 of Chap. VII. 

To show the existence of a solution with the properties described 
in the theorem, we now consider the set of all open intervals 
(jS, 7) containing with jS and 7 rational, on which a continuous 
solution through the point (^, 77) is defined. This set is denumer- 
able, and we may let (/ 3 n, 7^) denote a denumeration of it. Let 
2/1 be a solution on the interval (jSi, 71), and take the smallest 
integer ni > 1, if one exists, such that the interval yn) is 
not contained in (jSi, 71), and such that there is a solution 2/2 
on yn) equal to yi on the common part of the two intervals. 
Such a solution y^ defines an extension 2/2 of the solution yi to 
the sum of the intervals (jSi, 71) and yn)- Next take the 
smallest integer ^2 > ni such that a solution yz on yn) defines 
in a similar way an extension yz of 2/2. Proceeding in this way, 
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we obtain a finite or denumerable increasing sequence of solu- 
tions, whose logical sum defines a solution y{x) on an open 
inter\"al (a, 6). If a limiting point (ar, y) = (a, u) were interior to 
R, there would be a solution containing y{x) and defined on an 
inter\"al extending to the left of a, by an argument somewhat 
similar to that used in the proof of Theorem 4. Such a solution 
would have a section defined on an interv^al (i8„, 7 n) vith < cl. 
But this contradicts the definition of the solution y{x). 

A direct proof of the existence of a solution without the use of 
the Lipsehitz condition, using the Cauchy polygon method, is 
given, for example, in Kamke [3], pages 59-66, 126-130. 

*With the help of an additional hypothesis it may be proved 
that the graph of the solution described in Theorem 5 cannot have 
any limiting pomts at infinity except for a: = oo, as indicated 
below. 

*Theoeem 6. LetL(u) he a positive continuous function defined 

f * du 

for 0 ^ u < 00 j such that I y 7 ~\ diverges. Suppose that 

Jo L>{u) 

\\f(x, y)\ < L{ly\) for all values of x and y for which f is defined. 
Let y{x) be a continuous function having a derivative y'{x) = /(x, 
y{x)) on the interval a < x <b. Then the graph of y{x) has no 
limiting points at infinity unless a orb is infinite. 

Proof. — ^Let Uq — |l2/(9i|, where ^ is an arbitrary point of the 
interval (a, b). The function 


X = i/(u) 


=/‘ 


du 

Liu) 


+ 5 


is continuous and increasmg for w ^ 0, and Km = + oo , 

-}- 00 

and so 4/ has a single-valued inverse u = <t>{x) which is defined and 
continuous at least for | ^ a: < <» , and satisfies the differential 
equation u' = Ii(w). We shall show by an indirect proof that 
l|y(a^)ll = on the interval f ^ a; < 6, so that y{x) cannot 
have any limiting point at infinity as x approaches h imW h 
itself is in fini te. If there is a point Xi such that ||y(a:i) [| > 
there is a point xo such that ^ ^ xo < xi, |[ 2 /(a:o)|| = 4>(xo), and 
llyWIl > for Xo < ar < xi. Then l|2/'(xo)|| = ||/(x, 2/(xo))|| 
< Z,(||y(xo)ll) = ^'(xo), and hence ||y(x) - y{xa)\\ < 4>{x) - <p(xo) 
on a ^nall interval Xo < x < Xo + 5. From this we find immedi- 
ately l|y(x)|| ^ ||y(xo)|| + <Pix) - *(xo) = .^(x) for Xo < x < 
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Xo + 5, but this contradicts a preceding inequality. The cor- 
responding result for the interval a <x ^ ^ follows from the 
above by the transformation x = —t 

Another existence theorem, for the case when/(x, y) is continu- 
ous in y but merely integrable in the Lebesgue sense ^^ith respect 
to X, is discussed in Caratheodory’s Vorlesungen uher reeUe 
Funktionen, pages 665-688.^^^ A. resume of a number of other 
existence theorems and their applications has been published by 
W. M. Whyburn.^-^ Both the method of successive substitu- 
tions and the Cauchy polygon method may be extended to apply 
to a rather general type of integral equations.^^^ They may be 
used, of course, for the actual computation of solutions of par- 
ticular equations. For a discussion of convenient methods in the 
numerical solution of differential equations, see Moulton [1], 
Chaps. 12, 13; Bennett, Milne, and Bateman [7]; and Scarborough 
[9]. 

2. Special Properties of Linear Homogeneous Differential 
Equations. — In this section we wish to consider the special case 

(2:1) ^ = A{x)y 

of equation (1:8) iu which there are no terms independent of 
and A (a;) is a matrix of k rows and k columns whose elements are 
continuous on a ^ a; ^ As before, y is regarded as a matrix 
having only one column. If F(a;) is a matrix of several columns 
each of which is a solution of (2:1), we write 

F = A{x)Y 

and call Y a matrix solution of (2:1). The columns of a matrix 
solution Y form a fundamental set of solutions of (2:1) in case 
(a) these columns are linearly independent and (6) every solution 
of (2:1) is expressible linearly in terms of these columns. In 

^ See also McShane, Integroiion, Chap. 9. 

2 See Existence Theorems for Ordinary Differential Equaiions, Publications 
of the University of California at Los Angeles in Mathematical and Physical 
Sciences, Vol. 1, No. 2, pp. 115-133. * 

® See A. M. Killen, An Application of the Cauchy-LipscMz MeOwd to a 
System of Functional Equations, M.S. Thesis, Univeraty of Chicago, 1930; 
H, H. Bishop, Existence Theorems for a Cktss of Ifdegral Equations, M.S. 
Thesis, University of Chicago, 1935; Graves, Implicit Functions and 
Differential Equations in General Analysis,” Transactions of the American 
Maihemaiical Society, Vol. 29 (1927), pp. 514-552. 
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case k ^ 1, equation (2:1) may be explicitly solved, and in this 
case it is seen at once that every solution is a constant multiple 
of a particular solution. The proofs of the next two theorems are 
obvious. 

Theorem 7. The class of solutions of (2:1) is a linear set, 
that is, every linear combination with constant coefficients of solutions 
is also a solution. 

Theorem 8. If a solution of (2:1) has y{^) = 0 at a point 
then y{x) vanishes identically on [a, 6]. 

This is so since y{x) = 0 is always a solution, and by Theorem 1 
there is only one solution vith given initial values. 

Theorem 9. If F is a matrix solution of (2:1) then the columns 
of Y form a fundamental set of solutions if and only if Y is square 
and has a determinant not zero at one point In this case the 
determinant of Y does not vanish on [a, ?>]. 

Proof . — Since the initial values n = 2/(1) of a solution may be 
chosen arbitrarily, it is clear that Y must have at least k columns. 
If Y had more than k columns, then corresponding to a particular 
point I we could determine a matrix c of one column (and more 
than k rows) such that Y{i)c = 0. Then by Theorems 7 and 8 
we should have Y{x)c = 0 on [a, h], that is, the columns of Y 
would not be linearly independent. Hence Y is square. The 
argument just made applies also to show that det Y{x) cannot 
vanish on [a, 6], To prove the converse, suppose that 

det F(f) 5 ^ 0. 

Then the columns of Y are clearly linearly independent. Cor- 
responding to an arbitrary solution y(x) of (2:1), there is a matrix 
€ of one column such that 

F(?)c = 2/({): 

Since the two solutions Y(x)c and y(x) have the same initial 
values at they must be identical on [a, b] by Theorem 1. 

Theorem 10. There exists a matrix Y {x) whose columns form 
a fundamental set of solutions of (2:1). 

To see this, it is only necessary to take for the matrix F(|) of 
initial values the identity matrix J. Any other nonsingular 
matrix of initial values would do as well. 

From these theorems we see that the solutions of (2:1) form 
a Zr-dimensional linear subspace of the space of all continuous 
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functions on [a, 6] values in A-dimensional space. The solu- 
tions of a single linear homogeneous equation of the nth order 

^ + Pii^) + • • • + ■p„(x)y = 0 

form an n-dimensional linear subspace of the space S of con- 
tinuous real-valued functions. 

When the coefficients are constant, that is, when the matrix A 
is independent of x, explicit formulas for the solutions may be 
determined. For an excellent discussion of this case, see W. D. 
MacMillan, Dynamics of Rigid Bodies, pages 419^29. The 
method used there is due to W. Bartky. 

The follo^ving examples may serve as illustrations of the mean- 
ing of these theorems. Numerous other examples may be found 
in any elementary text on differential equations. 

F. xy' = y, 

G. 2/" + m^2/ = 0. 

H. a;y' = 2xy' - (x^ + 2)y. 

When G and H are written as systems of first-order equations, 
using the substitution yi — y, — y', we find that a matrix of 
solutions of G is 

( cos fXX 
— sm fix 

and a matrix of solutions of H is 

( X cos X 
—X sin a; + cos x 

The conclusion of Theorem 9 is violated in H as well as in F, 
but the hypotheses of this theorem are not fulfilled on any interval 
containing the point a; = 0. 

3. An Embedding Theorem, and the Differentiability of 
Solutions. — It is frequently desirable to know that a given solu- 
tion of a differential equation is embedded in a family of solutions 
and that the family is differentiable with respect to the constants 
of integration. The following embedding theorem is an easy 
coroUary of Theorem 4. 

Theorem 11. Suppose iJiat f(x, y, a) satisfies the hypotheses 
of Theorem 4, and that for ao ^ a; ^ &o, ^ = 2 /o(a;) is a solution of 


sm fixy 
cos fix) 


xsmx 
X cos a; + sin 


in a:). 
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(1:12) corresponding to a = ao, whose graph E lies in the section 
of R. Then there exists a positive number 8 such that the family 
of solutions y(Xi v, «) of (1:12) is defined and continuous for 
(?j 1?) in the neighborhood N(E; 8), a in N(cxo; 8) and ao — 5 ^ a; 
g 6o + 

Proof, — Since the set R is open, the solution yo{x) has by 
Theorem 4 an extension defined on an interval ao — 7 ^ a; ^ 6o 
+ 7. Let El denote the graph of this extended solution. Since 
the set of points (ar, y, af) with (x, y) on Ei is bounded and closed 
and interior to if, the Cartesian product of the neighborhoods 
N(Ei] e) and iV(ao; e) lies in if when e is suflSciently small. The 
family of solutions y{x, 77, a) given by Theorem 4 is continuous, 
so by Theorem 23 of Chap. IV it is uniformly contiauous for 
(^, 7?) on Ej a = aQ, Oq — Y ^ X ^ba + 7. Then there is a 
number 8 < e such that the graph of y(Xj 77 , a) lies in N{Ei; e) 
for (f, 77) in N(E; 8), a in N(cxo; 8), and ao — 5 ^ x g &o + 

For convenience we shall say that a function such as /(x, y, a) 
is of class in 2/ on a region if in case f and aU its partial deriva- 
tives -^vith respect to the components of y up to and including 
those of order p are defined and continuous in (x, y, a) throughout 
the region if. Partial derivatives will be iudicated by subscripts, 
except that derivatives with respect to x will usually be iudicated 
by accents as before. Thus the symbols fy and y,, denote square 
matrices of partial derivatives, while/, y, Zj yt, yi denote matrices 
of one column only. The proofs of the following theorems are 
based on a simple preliminary result, in the statement of which 
it is convenient to omit the parameters a. 

Lemma. Suppose that /(x, y) is of class C' in y on the open 
set if, and suppose that y(x, t) is a family of solutions of the differ-- 
ential equations y* = /(x, y), continuous in (x, i) and lying in R 
for Co ^ X ^ bo, \t\ < 8, Suppose in addition that the partial 
derivative 0) exists and is finite, where ^ is a fixed point of 
[a©, 60] • Then the derivative yt{x, 0) exists and is finite for ao ^ x 
^ 60, and is a solution of the linear differential equations 

(3-‘l) = fu{x, y{x, ^))z. 

Proof— If we set Ay ^ y(x, t) - y(x, 0), and 

t) = ffv(x, y(x, 0) + 0 Ay) de. 



Sec. 3] 


EMBEDDING THEOREM 


165 


■we see that Ay/t is a solution of the linear differential equations 
(3:2) z' = A(x, t)z. 

This system of equations has by Theorems 1 and 3 a unique con- 
tinuous family of solutions z{x, f, t) defined for oo S ^ bo, 
|^1 < 5, f arbitrary, and having z(|, t) = f. Thus 




and, since by hypothesis Ay(^)/t has a jBnite limit 0), we 
see that Ay(x)/t like\^ise has a finite limit 

yt(x, 0) = z(x, yti^, 0), 0) 

for ao ^ X ^ boj satisfying (3:2) for i = 0, that is, satisfying 
(3:1). 

Theorem 12. Suppose that f{x, a) is of doss in y 
on the open set R, Then the family y{x, ??, a) of solutions 
of the differential equations (1:12), given by Theorem 4, hcLs the 
property that the partial derivatives 

/O.O'^ V, a), yo(x, n, a), 

^ ^ y'i(x, V, a), y'„{x, f, V, oc), 

are defined and continuous and of class in 17 for (f, 17, a) in 
R and a(f, tj, a) < x < 6(f, 17, a). Moreover they satisfy the linear 
differential equations 

(3:4) z' = Mx, y{x, 5, n, «), «)» 

with the initial values 


yiii, S) ’!> «) = V, a), y^i^X, n , «) = I, 

where I is the identity mairix, and hence they are related by the 
formula 

(3:5) ydx, i, v, a) = -y^ix, 17 , a)/(f, v, «)• 

Proof. — We may clearly restrict attention to a closed interval 
[ao, 60] to which i and x are interior, and such that o(f, ij, a) 
< Oo < bo < b(|, V, a). On such an interval the preceding 
lemma is at once applicable 'to show the existence of y^ix, 17 , a), 
since y(^, I v, a) = V and hence J7,({, 17, «) = Moreover, by 

the lemma, y„(x, |, 17 , a) is a matrix solution of the equations 
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( 3 : 4 ), and by Theorem 4 this solution must be a continuous 
function of x and the parameters (^, i/, a). To show the existence 
of ^1, we take i in the lemma. We have (omitting 7} and a), 

Vil ^ + Al) - y(g, k) ^ 

and by the Theorem of the Alean for integrals and the continuity 
of f{x, y, a) this has the limit — /(f, v, o:)- Thus by the lemma 
the derivative y^(x, 17, a) exists and satisfies ( 3 : 4 ). Since 

l> V? ol) = I3 the columns of the matrix 2/, form a funda- 
mental set of solutions of ( 3 : 4 ), and since ( 3 : 5 ) holds for x = 
it holds for all values of x on [uo, bo]. The continuity of 2/j(rr, 

% a) follows from ( 3 : 5 ), and the continuity of 2/^ and ylj follows 
from ( 3 : 4 ). 

The proof may be completed by induction. Suppose that, 
whenever / is of class in the functions ( 3 : 3 ) are of class 
in 7]. Suppose also that the function /is of class in 
y. Then the right-hand sides of the equations 

2 ?' = Afe (x), a)z, 

vf = 0 , 

are of class in (0, w), and hence by the induction hypothesis 
their solutions z ~ z{x, f, 17, v, a), w = tjj are such that and 
2, are of class in (f, 17), that is, 0 is of class in (f, 17). 
It follows at once that yi{x, f, 07, a) = z{x, ~/(f, 17, a), rj, |, a) 
is of class in tj, and likewise for y,,{x^ f, 17, a). Since y^ and y^ 
are solutions of ( 3 : 4 ), it follows also that y\ and y[ are of class 
in rj, 

CoROLLAET, In case fix, y, ol) is of class in (y, a), then 
not only the partial derivatives (3:3) hut also ya(xj f, 17, a), y'^ix, f, 

77, a) are defined and continuous and of class in (17, 

Proof, — If we adjoin to the differential equations ( 1 : 12 ) the 
equations </ = 0, we have a system satisfying all the conditions 
of the theorem with y and a as the dependent variables, and 
consequently the solutions have the asserted differentiability 
properties with respect to the initial values 17 and a, 

Theoeem 13. Suppose that fix, y, a) is of class in iz, y, d) 
on R, Then the famdy yix, 17, d) of solutions of the differential 
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equation (1:12) and its derivative y'(x, rj, a) are of class in 

(x, %, n, <x). 

Proof. — By the preceding theorem and its coroUarj', y{x, ij, a) 
is of class C in {x, 17, a). Since 

( 3 : 6 ) i/ix, 17, a) = fix, yix, 17, a), a), 

y'{x, I, v, “) is also of class C'. To complete the proof we have 
to show that, when the statement holds for p = g, it must hold 
also for p = g + 1 . If / is of class and yix, rj, a) is of 
class then the right-hand sides of the two systems of diBfer- 
ential equations 

( 3 : 7 ) z' = fy(x, y{x, v, rj, a), a)z, 

( 3 : 8 ) 2' = fy{x, y{x, v, ri, a), a)z + fa{x, y(x, v, 77, a), a), 

are of class in (Xj 2, v, rj, a). If the statement holds for 

p = q, then the families of solutions z(Xj f, v, 77, a) of each of 
these systems wiU be of class in (x, J*, v, 77, a). Now the 

partial derivatives y^ and p, satisfy ( 3 : 7 ) with v = f and the 
initial values f = — /(|, 77, a) and f = J, respectively, and pa 
satisfies ( 3 : 8 ) with v — ^ and f = 0, so that y^, Pn, and y^ are of 
class By ( 3 :6), y'{Xj 77, a) is also of class so that y is 

of class and by another reference to ( 3 : 6 ), y' is also of 

class This completes the induction. 

As examples let us consider the following: 

J. y' = 2 \y\^\ 

K. y' = y^(x + y + xy^). 

L. p" = -g sin p. 

Example J is a slight modification of example A in Sec. 1 . It 
has the solution p = 0 . However, the solution p(a;, J, 77) has 
p(l, 0, 77) > 1 whenever 77 > 0 , and the conclusion of Theorem 11 
fails. In example E in Sec. 1 , every solution p(x, 77) with 
77 7*^ 0 becomes infinite at one end of its interval of definition, and 
y(x, 0) = 0, but nevertheless the preceding theorems are 
applicable. Since y(x, f, 77) = 77/[l + vU ^)] this example, 
we can verify directly that the following statement holds : 

( 3 : 9 ) M > 0 . « > 0 :D : 35 > 0 »: M < « . W < ikf 

* D ■ \y{x, 0, 17)1 < e. 

By Theorem 11 we know that the solutions are defined and that 
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(3:9) also holds in example K, although in this case we have no 
explicit formula for the solutions. Example L is the differential 
equation for the motion of a simple pendulum of unit length, 
where y is the angular displacement from the vertical and x is 
the time. If we denote the fanoiily of solutions by y{x, rj, rj'), 
we see that y(x, 0, x, 0) = x. This solution corresponds to the 
position of unstable equilibrium when the pendulum bob is at 
rest at its highest point. In this case the following statement 
holds by virtue of Theorem 11: 

M >0.€> 0 0:38 >0 91 117 I < 5. W ^ M 

• D * \yi^} 0, T, 7?0 - xl < €. 

This means that the pendulum will remain within an angular 
distance e of the vertically upward position for M units of time, 
provided its initial velocity is sufliciently small. 

4. First Integrals. — ^By definition a first integral of the system 
of differential equations (1:4) is a function G{x, y) which is of 
class C' on an open subset T of the set R, is not constant on T, 
and is such that for every solution y = 4>{x) of (1 :4) whose 
graph lies in T the fimction G{x, 4>{x)) is constant.^^^ Some 
results concerning first integrals follow immediately from the 
preceding sections. For convenience we shall now denote the 
family of solutions y{x, 17) given by Theorem 4 by <t>{x, 17), 

and denote its components by 77) for i = 1, • • * , k. 

Let J denote the projection of the region R on the a:-axis. For 
definiteness assume that /(a:, y) is of class C' in y. 

Theorem 14. For each i and each fixed f in J, <^i(?, Xj y) is a 
first integral. 

Proof . — ^({, Xj <#>(x, lo, v)) = ^(J, lo, ^), and this is independent 
of X. 

Theorem 15. For each fixed I in /, the k first integrals <^>i({, x, y) 
are independent. Moreover, any nonconstant differentiable func- 
tion of these first integrals is also a first integral. 

Proof . — ^The Jacobian of these first integrals as functions of y 
is the determinant of the matrix which is never zero by 
Theorems 9 and 12. Hence if H{y) is differentiable but not 
constant, x, y)) cannot be independent of y, so that there 

^ Some writers drop the adjective “first,” but other writers use the term 
“integral” where we have used “solution.” To avoid confusion we retain 
the classic terminology “first integral.” 
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can be no relation existing betwen the first integrals ar, y). 
It is obvious that x, y)) is also a first integral. 

Theorem 16. If G{x, y) is a first integral on an open subset T 
of Ry and ^ is in the projection A of T on the x-axiSy then on a 
suitable subset of Ty G may be expressed as a function of the first 
integrals Xy y)y so that these latter may be regarded as a funda-" 
mental set 

Proof. — Let £r(|, n) = Gixy <i>{Xy if). Then 

0(1, X, y)) = G{x, <t>(x, I <t>U, X, y))) 

= G{x, 4>{x, X, y)) 

= g[x, y). 

Theoeem 17. Let Gi(x, y), {i = 1, , k), he a set of first 

integrals defined on an open subset T of i?, whose Jacobian with 
respect to y is not zero on T. Then if the equations 

(4:1) Gi{x, y) = d 

have an initial solution (5, rj) in T, they define a solvlion y — y(x) 
of the differential equations (1 :4), passing through the point (f, tj), 
and extending from boundary to boundary of T, 

Proof. — ^By Theorem 3 of Chap. VIII^ the equations (4:1) 
have a unique solution y = y{x) through the point (J, y) and 
extending from boundary to boundary of T. The differential 
equations (1 :4) likewise have a unique solution y — y{x) through 
(^, 77). Since by definition a first integral is constant on each 
solution of (1 :4), these two functions y{x) and y{x) must coincide 
on their common interval of definition. 

Theorem 18. A function G(xy y)y of doss C' and not constant 
on an open subset T of R, is a first inlegral of (1 :4) if and ordy if 
it is a solution of the linear homogeneous partial differential equation 







on T. 

This follows immediately froin the definition of first integral. 

From the theorems of this chapter it follows that the problems 
of finding the general solution of the system of ordinary differ- 
ential equations (1:4) and of finding the general solution of the 
partial differential equation (4:2) are eqmvalent problems. 
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Moreover, a knowledge of one or more first integrals may theo- 
retically be used to reduce the order of the system (1 :4). This is 
sometimes but not always an advantage in the practical determi- 
nation of the solutions of this system.^^^ 

The following examples are taken from problems of dynamics 
and the independent variable x represents the time, while G and 
H are first integrals. 

M. y" = -g; G = 2gy + y'^, H = -gx-/2 — t/x + y, 

X. y" = sin 2 /; (? = —2g cos y + y'-. 
p. = + 

Q. r" = rd'2 - A-Vr2, = -2r'^7r;(? = r'^ + - 2A*Vr, 

H = r^^'. 

In each of these examples the first integral G is proportional to 
the sum of the kinetic and potential energies. In example Q the 
differential equations are those for the motion of a particle in 
a central field of force, in which the force is inversely proportional 
to the square of the distance, and r and 6 are polar coordinates. 
The first integral H in this case is the rate at which the radius 
vector sweeps over area. In examples M and P the solutions are 
readily obtained in explicit form, and so other first integrals may 
be written down at once, by virtue of Theorems 14 and 15. 

6. Equations in the Form F(x, y, y') = 0.— Differential equa- 
tions frequently arise which are not solved for the derivatives. 
Theorems concerning their solutions can be obtained by combin- 
ing the results of the preceding sections with the implicit func- 
tion theorems of Chap. VIII. 

We shall consider a fxmction F(x, y, z), which is of class on 
an open set R in {x, y, ;2)-space, where p ^ 1. The function F 
and the variables y and z are each supposed to have the same 
number of components. FoUovdng the terminology of Chap. 
VIII, Sec. 3, an ordinary point for F is defined to be a point 
(a:, p, 2 ) in J? such that the matrix of partial derivatives Fz{Xj p, z) 
is nonsingular. All other points are exceptional points. 

Theorem 19. For every ordinary point (?, rt , f) for the function 
Fy unth F(|, /?, f) = 0, there is a unique continuous solution 
iy ny t) of the differential equations 

(5:1) F{x, y, p') = 0 

^ See, for example, Moulton [IJ, Chap. 5. 
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and initial conditions 

Vi f) = V, y'i^i Vi f) = r, 

defined on an interval a < x < b such that on this interval the point 
(,^3 yip'i ^3 Vy ^*)j y (^3 ^7 Vi t)\ 

of {2k + l)-dimensional space is always an ordinary point for F, 
while the only finite limiting values of as x approaches a orb are 
exceptional points for F, When f = f ri) is a continuous solu- 
tion of F{^, 7]j ^) = 0 composed of ordinary points for F, y{Xy 
f (?, v)) ^nd y'{x, I Tj, 7?)) are of class in (x, 77). 

Proof. — ^By Theorem 2 of Chap. VIII, the equations Fix, y, z) 
— 0 have one and only one solution z = f{x, y) defined near the 
point (?, 77) and having values near f, and this solution is of 
class Then the differential equations ?/' = fix, y) have a 

unique continuous solution yix, 77) defined for x near and 
yix, 77) and y'ix, 77) are of class in all their arguments, by 
Theorem 13. When the equation F(f, 77, f) = 0 has more than 
one solution for f, the solution yix, J, 77) of the differential equa- 
tions (5:1) depends also on and we may indicate this by VTiting 
yi^i ^7 Vi f)- The above argument shows that a continuous 
solution yix) of (5:1), all of whose elements (x, y{x), y'ix)) are 
ordinary points for F, is uniquely determined by its initial values. 
Now let yix, n, f) be the logical sum of all continuous solutions 
passing through the initial element (J, 77, f), satisfying the last 
statement of the theorem, and with no elements that are excep- 
tional points for F. This function is defined for a; on an open 
interval (a, b), and it remains only to show that the only finite 
limiting points of Px as x approaches a orb are exceptional points 
for F. This is accomplished as in the proof of Theorem 4. 

Theorem 20. Suppose that Fix, y, z) is of class on an open 
set R, and that 

E: y = yoix), ao ^ x ^ bo, 

is a solution of class C' of the differential equoMons ( 5 : 1 ), akmg 
which the matrix Fz is nonsingular. Let Ei denote the set of points 
ix, yoix), y'oix)), ao ^ X ^ b. Then there exist positive numbers 
€ and d and a unique function yix, 77) defined for ao — h ^ x ^bo 
+ B and (f, 77) in the neighborhood N(E; 8), such that {x, yix, 77), 
y'ix, I, 77)) lies in NiEi; e) and satisfies the differential equations 
( 5 : 1 ). The functions yix, f, 77) and y'ix, 77) are of (doss 
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Proof , — By Theorem 4 of Chap. VIII, there exist positive 
numbers e and 8i and a function /(x, y) such that /is of class 
on N(E; di), and for each (x, y) in this neighborhood (x, y, /(x, y)) 
is the unique solution in N(Ei; e) of F{x, y, z) = 0. Then by 
Theorem 11, the conclusion stated must hold for a sufficiently 
small 8 < 5i. The differentiability follows from Theorem 13. 

In the following examples there are singular solutions which 
correspond to exceptional points for the function F, 

R. + 2/— 1 = 0. 

s. y? - y'i + yl-yl - 1 = 0 , yW, + y^y^ = 0. 

T. y'l - y'i + 42/1 cos 2x — 4y2 sin 2x = 0, 2y[yz + 4yi sin 2x 
+ 42/2 cos 2x = 0. 

The solutions of R guaranteed by Theorem 19 are the arcs of 
the curves 2/ = sin (x + C) between the points of contact with the 
singular solutions 2/ = ± 1. The solutions of S are given by the 
formulas 2/i “ (1 + sin (x + Ci), y^ = C 2 cos (x + Ci). 
For C2 7^ 0 the solutions extend from x = — ootox = + 00 with- 
out approaching an exceptional point, but for (72 = 0 the situa- 
tion reduces essentially to that of example R. If we set (7i == t/2 
+ e cos t, Cz = sinh (e sin t), and take ^ = 0, then as t varies 
through an interval of length x, the initial values rji and tjz 
return to their original values, but f 1 and f 2 become the negatives 
of their original values. The interval (a, 6) of definition of the 
solution, described in Theorem 19, becomes finite whenever 
sin ^ = 0. The solutions of T are given by the formulas 

2/1 = (cos X + ci)^ — (sin X + 

2/2 = 2(cos X + Cl) (sin x + C2). 

One of these solutions meets the singular solution = 2/2 = 0 
if and only if cf + c| = 1. 
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CHAPTER X 

THE LEBESGUE INTEGRAL 

1. Introduction. — The theory of Lebesgue integrals will be 
developed here from the point of view originally expounded by 
F. Riesz [8]. This makes it possible to prove the important 
convergence and approximation theorems for integrals at the 
very outset, in a simple way, on the basis of only a rudimentary 
theory of point sets and measure. The general theory of measure 
becomes a corollary of the theorems on integrals. The method 
of Riesz also makes possible a simple and brief treatment of the 
differentiation of indefinite integrals of functions of one variable. 

The theory will be phrased in terms of functions of a single 
real variable. However many of the definitions and theorems, 
especially in the earlier sections, are equally valid for integrals 
of functions of any finite number of variables, and for a general- 
ized measure function replacing the ordinary length, area, 
volume, etc., but having the properties specified in Sec. % When 
a general measure function is used, the integral usually known 
as the Lebesgue-Stieltjes integral is obtained. Those theorems 
which are not known to be valid for the Lebesgue-Stieltjes 
integral in several dimensions are marked with a f. Occasionally 
indications will be given, in paragraphs marked with a *, of the 
necessary modifications in terminology and proofs for the case 
of functions of several variables or for the Lebesgue-Stieltjes 
integral. These paragraphs may well be omitted at a first 
reading. The reader who wishes to gain a knowledge of the 
Lebesgue-Stieltjes integral should restudy this chapter in connec- 
tion with Chap. XII. 

The method of Riesz for the definition of the integral is exten- 
sible to the case when the independent variable ranges over a 
topological space in which a suitable measure is defined, and the 
functional values lie in a Banach spaceJ^^ 

^ For the second aspect of the generalization, see Bochner, 'Tnt^ation 
von Funktionen deren Werte die Elemente eines Vektoiraumes sind/' 
M(X^hemaUcaej Vol. 20 (1933), pp. 262-276, 

X73 
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2. Point Sets and Functions of Intervals. — ^An interval is a 
set of points of the real axis defined by one of the following types 
of conditions: 


a ^ X ^ 
a £ X <b, 
a < X ^ b, 
a < X <b. 

An interval of the first type is closed, one of the fourth is open, 
while an interval of the second or third type may be called 
half -open. An interval of the first type vAth a = 5 is a degener- 
ate interval or a point. For convenience the null set will also be 
considered as an interval. 

*In a space of more than one dimension, an interval would be 
defined by taking an inequality of one of the four types for each 
coordinate. In this case there are various degrees of degeneracy 
of intervals. 

All point sets .B to be considered in this chapter are subsets of a 
nondegenerate finite closed fundamental interval I. All comple- 
ments of sets are then taken with respect to I, that is, the com- 
plement of a set E, denoted by cB, is defined to be J — B. A set 
B is open relative to / in case its complement is closed. Here- 
after the term “open^^ is imderstood to mean ‘^relative to 

The sets of a family are said to be disjoint in case no two of 
them have an element in common. 

We shall be interested in an interval function m(i) which is 
defined for all subintervals i of I. Such a function m is said to be 
additive in case 

m(ii) = 771(4) + m{iz), 

whenever ii is the sum of disj oint intervals 4 and is. We suppose 
that the interval function m{i) is nonnegative, finite, and additive, 
and that it has the additional properties 

(2A) ~ 771(4) for all open ii D i, 

^ ^ m(i) = l.u.b. 7 ?i( 4) for all closed 4 C i. 

The simplest example of such a function is the length of the 
interval. With it we obtain the ordinary Lebesgue integral in 
the developments that follow. 

*For intervals in two dimensions, length is to be replaced by 
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area. Other examples of additive interval functions of the 
above type are obtained by using the increments of nondecreasing 
bounded functions f{x). If i is the open interval a < rc < 5, we 
should then set 


mii) =y(6_0 )-/(a + 0), 

where f(a + 0), for example, denotes the right-hand limit of 
f(x) at a. If i is the closed inter\’'al a ^ x ^ b, we set 

Mi) =/(& + 0) -/(a-0). 

For a function /(xi, x^) of two variables which is nondecreasing 
in a suitable sense, and an open interval 

i: Gi < Xi < hi, Gz < X2 < hzi 

we set 

m(i) = f(bi — 0, 62 0) — f(ai + 0, 52 — 0) 

fibi — 0, a2 + 0) + f(ai + 0, 02 + 0). 

When these more general interval functions m(i) are admitted, 
we obtain the generalization of the Lebesgue integral usually 
known as the Lebesgue-Stieltjes integral. 

We shall be interested in certain special classes of point sets 
in I. The class 31 consists of all point sets A, each of which 
is the sum of a finite number of disjoint intervals. The class 5 
consists of all sets C, each of which is the sum of a finite or 

Q 

denumerable number of disjoint intervals. If d = ^ 4, 
(7 = ^ we set 

m(d) = ^ m(4), m(C) = ^ m(4). 

Here and in the following the summation sign ^ without any 

attached index of summation will be used to indicate summation 
over all possible values of the variable, and so may indicate either 
a finite sum or an infinite series. The justification for the 
definition of m(A) is obtained by considering any two representa- 
tions y 4 and T f'- of A as a sum of disjoint intervals, and a 
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third representation such that each interval ih or i'- is a sum 

of certain intervals and the sum of any tvro adjacent intervals 
i" and is again an interval. The justification of the definition 
given for m(C) is pro\fided by the CoroUarj- of Lemma 2. 

Since the product of two iater\"als is obviously an interval 
and the complement of an inter\"al is m 2t, we can readily verify 
the following properties of the class SI: 

1. The class St is closed with respect to the operations of 
taking complements, differences, and finite sums and products. If 

A.^A„ 

1 

0 . 

(2:2) m{A) ^ ^ m{A,). 

1 

When the sets A,- are disjoint, the inequality in (2:2) should he 
replaced by equality. 

In order to justify the definition of m{C) we need the following 
proposition: 

Lemma 2. Let C = ^ih be a subset of E il, where the 
intervals are not required to be disjoint. Then 

^ m(4) ^ ^ m«). 

Proof . — ^By (2:1), for an arbitrary positive e, each interval 
can be enlarged into an inierval 4' in such a way that every 
point of C is interior to some i'^, and 

2 - Y, 

Likewise each interval i^ contains a closed interval i\ such that 

^ m(it) ^ Y, ~ *• 

Then for each q the set .4 = ^ is a bounded closed set covered 

1 

by the family of intervals 4'. By the Borel theorem, A is 
covered by a finite number i'f, . . . , of these intervals, Thus 
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lm(il) ^lm(i''), 

^ miik) g ^ 771(4) + 2«, 

and since € is arbitrary, the desired inequality follows. 

CoROLLAKY. Let ^ 4 = ^ i'h be two represenfaiiom of a set C 
as a sum of disjoint intervals. Then 

^ m(4). 

The following result is easily obtamed by use of Lemma 1. 
Lemma 3. If E is a denumerable sum of intervals^ then E is in 6. 
Lemma 4. The class S is closed with respect to the operations 
of taking denumerable sums and finite products. If Ci C Cj, 

m(Ci) g mCCa). HC = 2 Ci, 

(2:3) m(C) g ^ m(C,). 

When the sets Cf are disjoint j the inequality in (2:3) should be 
replaced by equality. 

Proof . — The closure of S with respect to sums follows from 
Lemma 3, and that with respect to products from the formula 

X A “ X 

h V hk 

The remaining statements follow from Lemma 2. 

Lemma 5. Every open sel E is in S. When the fundamenial 
interval I is one-dimensional^ an open set E has a uniqm represerUon 
tion {apart from order) as a sum of di^oint open intervals. 

Proof for the One-dimensional Case . — Let (Xn) be a denumerable 
set dense on I. Then each point Xn is contained in a maximum 
open interval u contained in E. (This interval in is null when 
Xn is not in E.) Let ni = 1 and let be the least integer such 
that Xnt is not in Uz the least integer such that Xn^ is not in 
ini + in»} and so on. Then 
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*Proof for the General Case . — ^As before, let (xn) be a denumer- 
able set dense on J. Let ink denote the “cube” ^rith center Xn 
and edge l/k\ Then E is the sum of the intervals ink which are 
contained in E, and hence is in S by Lemma 3. 

A set is a set of measure zero in case for every e > 0 there 
is a set C in S such that C Z and m{C) < e. The following 
properties are easily proved: 

Le3£MA 6. Every subset of a set of measure zero is also of 
measure zero. 

Lemma 7. The sum of a denumerable number of sets of measure 
zero is also of measure zero. 

We shall need also the following fundamental result: 

Lemma 8. Let (Cn) be a sequence of sets in S such that 

lim sup Cn == Z, 

where Z is a set of measure zero. Then 
lim m((7n) = 0. 

Proo/.— Let Ct = T Then Z = 1[Ch, C Cu, m{Ck) 

^ n^k k 

^ m(Ck)) by Lemma 4. Thus it suffices to consider the case 
when the sequence (C„) is nonincreasing. If the lemma is false 
in this case, there exists a positive number 5 such that m(Cn) > 8 

for every n. Let e be positive but less than 8. Let Cn = \ ink 

T 

be a representation of as a sum of disjoint intervals. By 
(2:1) each interval contains a closed interval such that 
> ^(inh) ” Then if 

Pn 

with Pn sufficiently large, we shall have 
(2:4) m(An) > m(Cn) — e/2". 

n 

Now let = n Then In+i C An C C C„ C Cn-i, and 

«0 00 eo 

n in = n An C UCn = Z. 

n=sl n = l ns=l 


(2:5) 
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We shall prove by induction that 

(2:6) m(An) > m(C„) - e(l - l). 

For 71 = 1, this inequality is the same as (2:4). Now since An 
and An^i are both subsets of Cn, we have 

m(An+i) + in(A^ - Ar^i)^^ m{Cn), 
m(An) = m(AnAn+l) + m(in “ An+i). 

By adding the last two statements and transposing the term 
miCn)} we obtain 

m{Ani.l) = 7n(AnAn+l) ^ m(An) + m(An^i) - 7n(Cn). 

From this and (2:6), and (2:4) with n replaced by + 1, we 
find that 

m(An+i) > m(Cn) - € ^1 - 7n(Cn) 

= - e(l - 

and this is (2:6) with n replaced by + 1. Thus we have for 
every n, 

(2:7) m(An) > 5 - e. 

Now let C be a sum of intervals enclosing Z, and such that 

(2:8) m(C) < (5 - 6)/2. 

By (2:1) we may suppose that the intervals composing C are 
open. From (2:7) and (2:8) and Lemma 2 it follows that the set 
(An — C) is nonnuU for every n. Each of these sets is bounded 
and closed, and they form a decreasing sequence. Hence they 
have at least one point in common by Corollary 3 of Theorem 10 
in Chap. IV. But this contradicts (2:5), and thus the lemma is 
proved. 

fTwo examples of sets of measure zero were mentioned on 
page 89. Another example may be constructed by selecting 
from the interval [0, 1] the points x in whose decimal repr^nta- 

tion X — ^ 0,10^* the sequence of odd-numbered digits is 

ultimately periodic. The set of all points 2 ? = Y a2fl0^^ is con- 
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tained in intervals remaining after remo\dng a set of intervals 
with, length sum 0.9, 0.99, 0.999, . . . , and hence has measure 

zero. The points y = ^ are rational, and so the 

set of ail points of the form x == y z is the sum of a denumer- 
able infinity of sets of measure zero. 

fFrom a two-dimensional interval I we may select two sets 
of measure zero as follows. Let Ei consist of all points (x, y) 
with X and y both rational and having the same denominator. 
(It is understood that all rational numbers are represented in 
their lowest terms.) Let consist of all (a:, y) with x rational 
and y irrational, or y rational with a different denominator from 
that of X, Each of these two sets is of two-dimensional measure 
zero, and each is dense on I, The set Ei has only a finite number 
of points on each parallel to a coordinate axis. 

3. Definition and Properties of the Integral. — ^Let Q be an 
arbitrary class and let P denote a property that may be possessed 
by some subclasses of C. The property P is said to be exten- 
sionaUy attainable m O in case for every subclass Clo of O there 
exists a subclass Oi containing Do and having the property P, 
and such that every other subclass D 2 containing Do and having 
the property P contains Di. The class Di may be described as 
the minimum class containing Do and having the property P, 
and when it exists it is called the extension of Do to have prop- 
erty P. In case D is the interval I, the property of being an 
open set is not extensionally attainable, while the property of 
being a closed set is extensionally attainable. The following 
necessary and sufficient condition for extensional attainability is 
easily proved. 

Lemma 9. A pro'perty P is extensionally attainable in D if and 
only if 

(i) D itself has the property P; 

(ii) The logical product of a family of subsets, each having the 
property P, itself always has the property P. 

Now let D be the class of all functions ^ which are single-real- 
valued in the interval 7. We shall be interested in the following 
operations on functions in D: 

I. Addition: -f ^ 2 . 

II. Multiplication by a constant: a^. 

IIL Multiplication: ^ 1 ^ 2 . 
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IV. Logical addition: ^3 = V ^2, where for each x the value 
ypzix) is the greater of ^i{x) and ^2(0:), 

V. Logical multiplication: ^3 = A where for each x 
the value }pz{x) is the lesser of ^i{x) and 

We shall sometimes wish to admit functions ^ which have 
infinite values, and we could adopt conventions as to the values 
obtained by adding and multiplying infinite values, but this will 
not be necessary. 

It is clear that the property of being closed Tiith respect to an 
arbitrary one of the operations I to V is extensionally attainable 
in O. Moreover the extension of a class Oo is the class of all 
functions obtainable from those in Oo by a finite number of 
applications of the operation in question. A class which is 
closed with respect to both the operations I and II is called 
linear. 

We note that a class Oo which is closed with respect to the 
operations II and IV is also closed with respect to the operation 
of taking the absolute value, since 

W = ^ V ( -- P), 

A very convenient concept is that of the characteristic function 
(pE of a set E, which is defined to have the value unity at elements 
X of Ej and the value zero elsewhere. 

Let Oo be the class of all characteristic functions <}>a of sets 
A in 21, and let the extension of Oo to be linear be denoted by ©. 
The functions in the class © are frequently called step functions. 
We shall use the notation a(x) for step functions. It is eaaly 
seen that the class © is also closed with respect to the operations 
III to V. The integrals of step functions are defined in the 
obvious way as finite sums. Let the fundamental interval I be 
represented as a sum of disjoint intervals 4 in any way such that 
the function a has the constant value ah on 4 - Then 

a{x) akm{ik). 

When convenient, we may also use the notations 
a(x) dx or j a dx 

for this integral. It is easy to see that the value obtained for 
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the integral is the same for all decompositions of the interval I 
subject to the conditions stated. 

An operator if(^) with domain do is said to be linear in case 
Oo is linear, and 

i^(^i + ^2) = 
i5:(a^i) = 

for every ^1 and \p2 in Oo and every constant a. An operator 
K(yl/) is said to be positive in case ^ 0 whenever ^ 0 
for aU :r in /. A positive linear operator has the following addi- 
tional properties: 

^ K(\1/2) w^henever ^i(x) S ^2(2;); 

\K(^)\ ^ whenever [^1 is also inOo. 

The integral 

K(a) = J adx 

is obviously a positive linear operator on the class © of step 
functions. 

*In case the interval function m(i) is not the length of the 
interval, it is more appropriate to replace the symbol dx occurring 
in the notation for the integral by dm, in order to indicate the 
dependence of the integral on the choice of m. In this chapter 
and the next we shall use the notations indicated above. But 
when immediate generalization to the case of an arbitrary interval 
function satisfying the conditions stated in Sec. 2 is not possible, 
that fact will be indicated by a dagger (t). 

*Note that a step function a may be such that it takes a 
particular value a at only a single point. When the value of the 
interval function m is zero for every degenerate interval, an 
arbitrary change in the value of a at a finite number of points 
does not affect the value of the integral, but in other cases it may 
affect it. 

The notation E[ ... ]is used to denote the set of all points 
of the interval I at which the property in the brackets holds. 

A property P of points x is said to hold almost ever3nvhere 
in case there exists a set Z of zero measure such that P holds 
on the complement of Z. For example, a function ^ is finite 
almost everywhere in case the set E[\!/{x) = + 00 ] is a set of 
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measure zero. Also, lim i^n = ^ almost everywhere in case 

n 

lim ^n(^) = with the possible exception of the points 5 : in a 

n 

set Z of measure zero. 

A function n is said to be measurable in case there exists a 
sequence (an) of step functions such that lim an = fi almost 

n 

everywhere. The class of all measurable functions fi will be 
denoted by 30?. We note that a measurable function p, may have 
infinite values. We show later (Theorem 4, Corollary^ that the 
class 3D? is the extension of the class $ to be closed with respect to 
the operation of taking limits in the sense of ^almost everywhere.^^ 
A function ^ is said to be essentially bounded or almost 
bounded in case there exists a set Z of measure zero such that ^ 
is bounded on the complement of Z, The subclass of 2)? con- 
sisting of those functions p which are essentially bounded will be 
denoted by The subclass consisting of those functions p 
which are finite almost everyw'here ^dll be denoted by 2)?j?. 
Then 9 }?b C 9D?i? C 90?. If /t is in and h and K are constants 
such that k S ^ K almost everywhere, then there exists a 
sequence (q:«) of step functions such that k S ctnix) S K for all 
X and lim = p almost everywhere. This is easily verified 

n 

since the class ® of step functions is closed with respect to the 
operations IV and V. 

A sequence of functions is said to converge almost uni- 
formly to a function ^ in case for every positive e there exists a 
set C in £ such that m(C) < e and lim ^ uniformly on the 

n 

complement of C. Here it is understood that ip has finite valu^ 
on the complement of C. The relation of this useful type of 
convergence with convergence almost everywhere is partly indi- 
cated in the following two theorems, the second of which is a 
special case of a theorem of Egoroff. 

Theorem 1. If lim ipn — almost uniformly, then lim ipn ^ 

n n 

almost everywhere. 

Proof. — ^Let C® correspond to « = l/gj in tiie definition of 
almost uniform convergence, and let jE? = H Then lim 

n 

= ^ Qn the complement of E. Since E Q Cq and m(Cq) < 1/q 
for every jB is a set of measure zero. 
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Theorem 2. Let (a„) he a sequence of step functions converging 
almost everywhere to a function y. which is finite almost everywhere. 
Then lim = y almost uniformly. 

n 

Proof . — ^Let Z denote the set of points at which either the limit 
y is infinite or the convergence of Q:n to /x fails. Let 


C,, = 2 El\a,(x) - aM > l/q]. 

hj^h 


The sequence (Cif) is nonincreasing with respect to k, and 

OO 

n C Z for every q. Hence by Lemma 8, lim m(Ckq) = 0. 

Thus for an arbitrarj' positive number e and for each q there 
exists an integer kj such that Jn(Ci,,) < e/29. Let Co be a set 

in E including Z, uith jra(Co) < e. If -we set C = Co + ^ Ck,^, 

we have m(C) < 2e by Lemma 4, and |a:j(a;) — iu(a;)| ^ 1/^ on 
the complement of C for A > kq. 

CoROLLAST. Lei (an) be a sequence of step functions converging 
almost everywhere to a function u and let E+ = E\}t(x) = +«], 
E- = E[fiix) = — oo]. Then for every e > 0 there exists a set C 
in S with m(C) < «, and such that for every S > 0 there emsts an 
integer q such that when n > q, an(x) > d an E+ — C, and <Xn{x) 
< — S on E- — C. 

Proof . — ^Let 


(3:1) 




1 + l«n(a:)j’ 


u(x) 


ujx) 

1 + |M(a:)r 


Then the hypotheses of the theorem are fuMUed by (a.) and jli, 
so that when q is sufficiently great, and n > q, and x is in £+ — C, 
we have ’ 

1 + a»(a:) ^ 

and hence Qt»(x) > S. A similar manipulation gives the cor- 
responding inequality on E- — C. 

Iffie f ollowing theorem gives the definition of the integral and 
its justification, for essentially bounded measurable functions. 
This case is taken up first because it is somewhat simpler 
the general case. But Theorems 3 to 5 could be omitted. 
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Theoeem 3. Let (otn) he an essentially hounded sequence of 
step functions converging almost everywhere to a function /*. Then 
the sequence of integrals 

(3:2) 

has a finite limit which depends only on the function fi and is 
denoted hy jj y dx. 

Proof — Suppose !an(a;)j ^ iT, and let e be an arbitrary positive 
number. Then by Theorem 2, there exists a set C in S and an 
integers such that m(C) < c/4Z, and \ap{x) - ^ €/2m(7) 

whenever p > n, q > n, except on a subset of C, Hence from 
the definition of the integral for step functions it follows that 

apdx — aq da;j ^ €, 

whenever p > n, q > n. This establishes the existence of the 
limit of the sequence (3:2). To show that it depends only on 
the function let (a«) and (af) be two sequences satisfying 
the conditions of the theorem, and converging almost everyvrhere 
to the same function y. Form a new sequence (q:„) by taking 
terms alternately from and (a'')* Then the sequences 

Jj. CXn dx^ dXj OL^ dx 

all converge, and since the second and third are subsequences 
of the first, they all have the same limit. 

The next theorem gives a sufficient condition for teim-by-term 
integration of sequences of functions in the class Mb. 

Theorem 4. Let {y^^ he an essentially hounded sequence of 
measurable functions converging almost everywhere to a function 
Then ^ is measurable and essentially hounded, and 



Proof. — Let X be a constant such that \yn(x)\ ^ K almost 
everywhere, for all values of n. For each n there is a sequence 
of step functions {aun) such that lim akn = y^ almost everywhere, 

and \akn(x)\ ^ iT. Corresponding to a sequence of int^exs 
(kn), let be denoted by By Theorems 2 and 3, for every 
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n there exists a set (7» in S and an integer A-„ such that 

m(C,) < l/2», 

lonCa;) - Ai«(a:)i < 1/2“ on / - 

(3:3) 5n dx Jj ^ ^ 1/2". 

Let 

eo 

Cg = ^ 

so that in{Cg) < l/2«. Then 
(3:4) lim (o^ — Mb) = 0 

n 

on I — C, for every q, and hence (3:4) holds almost everywhere, 
and lim = 4' almost eveiywhere. Thus is in and 

n 

lim f dindx ^ L^'dx by Theorem 3, and from this and (3:3) 
the final conclusion follows. 

CoROLLAEY. If (fin) is a seqvmce of measurable functions whose 
limit is almost everywhere a function then rp is also measurable. 

This follows from the theorem by the use of the same type of 
transformation (3:1) as was used in the proof of the Corollary 
of Theorem 2. 

Theorem 5. The class Tls of essentially bounded measurable 
functions is dosed with respect to the operations I to V. The class 
SRj? of measurable functions which are finite-valued almost every- 
where is also dosed with respect to these operations^ provided it is 
agreed that the values of sums and products may be arbitrarily 
assigned at points where they may be undefined. The integral is a 
positive linear operator on the dass TIb. 

These statements follow readily from the fact that the opera- 
tion of taking limits is commutative with each of the operations 
I to V. A sum or a product in the class may lead to one 
of the indeterminate forms oo — oo or 0* oo , but this can happen 
only at the points of a set of measure zero. 

. It is clear from the definitions that changmg the value of a 
function at a set of measure zero cannot alter its measurability, 
integrability, nor the value of its integral. A function y may 
even remain undefined on a set Z of measure zero, but we shall 
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still use the symbol 



when II is integrable. In this situation, many authors prefer 
to make the agreement that jtt shall be set equal to some con- 
venient value (say zero) on the set Z. 

We now proceed to the case when the assumption of bounded- 
ness is omitted. However, another hypothesis must take its 
place. In order to introduce this we find the following notation 
convenient, namely, 

^ a dx = y 0 L(}tA dx, 

where the set A is in St, and <j>A is its characteristic function. 
The product a<j>A is then also a step function. When the set A 

is regarded as variable, a dx is called the indefinite integral 

of a. It is evidently always absolutely continuous as a function 
of A, in the sense that 

lim I a dx = 0. 

The integrals Jandx of a sequence are said to be absolutely 
continuous uniformly with respect to n in case 

lim / an dx — 0 

uniformly with respect to n. This definition will later be 
extended to more general functions and sets. The phrase 
‘^equiabsolutely continuous^' is sometimes used for this notion, 
which is related to the notion of equicontinuous functions 
described in Chap. VII. We shall need two preliminary results 
before proceeding to the generalization of Theorem 3 to the 
unbounded case. 

tLEMMA 10. If the integrak j^andx are absolutely continuous 
uniformly with respect to n, then they are bounded uniformly with 
respect to A and n, 

*This le mm a and its proof hold also for generalized measure 
functions in any number of dimensions, provided that the measure 
function m satisfies the condition that the fundamental interval I 
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can he divided into a finite number of subintervals of arbitrarily 
small measure. TThen the inten^al I is one-dimensional and the 
measure m{i) is obtained from a nondecreasing function /(a;), the 
preceding condition is satisfied if and only if f{x) is continuous. 

Proof . — Suppose that 5 is such that 1 whenever 

m(A) < 5. Let the fundamental interv'al I be di\dded into K 
subinter\"als each of measure less than 5. Then iT is a bound for 
the integrals. 

T. FArvTA 11. Suppose that the integrals an dx are bounded 

uniformly with respect to A and n, and that lim an = almost 
everywhere. Then y is finite almost everywhere. 

Proof . — Suppose that the set E+ = E[y{x) = +oc] is not of 
measure zero, that is, suppose that there exists a positive € such 
that m{C) > 2€ for every set C in S including E^. Correspond- 
ing to € let Co be a set in S satisfying the conditions of the Corol- 
lary of Theorem 2, so that m(Co) < €. For an arbitrarily large 
number 5 the set of points at which an{x) > 5 is a set An which 
includes (S+ — Co) for n sufficiently large, and hence > e, 

and 

andx > ed. 

This contradicts the boundedness of the integrals. A similar 
proof shows that the set E[fi(x) = — «»] is of measure zero. 

tTHEOREM 6. Suppose that (an) is a sequence of step functions 
converging almost everywhere to a function y, and that the integrals 

( 3 : 5 ) 

are absolutely continuous uniformly with respect to n. Then the 
sequence (3:5) converges uniformly for sets A in 31, and the value 
of the limit depends only on the function m ond the set A, and is 

denoted by the symbol y dx. Moreoverj p is finite almost 
everywhere. 

*The preceding theorem holds also for general measure func- 
tions with- the added hypothesis that the function p is finite 
almost everywhere j or that the sequence (3:5) is uniformly hounded. 
Compare also the remark following Lemma 10. 

Proof . — ^Let 6 be an arbitrary positive number, and let 6 
correspond to « as in the definition of uniform absolute continuity. 
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By Lemmas 10 and 11, the function jx is finite almost eveiyw'here, 
so that by Theorem 2 there exists a set C in 6 and an integer n 
such that m{C) < 8 and the set Ap^ == E['ap(x) — ag(x)i > e] is 
included in C whenever p and q are both greater than n. For 
an arbitrary set A in §l and p > n^q > n, let us set Bpq = A • 

Dpq = A — Apq, Then m{Bp^ < 8, and 

Ia H ^ M + 1/b„ 

^ 26 + €m(A) g e[2 + mil)]. 


Thus the Cauchy condition for the uniform convergence of the 
sequence of integrals is satisfied. That the value of the limit 
depends only on the function fi and the set A is shown by the 
same device as in the proof of Theorem 3. 

Fimctions p satisf 3 dng the hypotheses of Theorem 6 will be 
called integrable (or integrable in the sense of Lebesgue). They 
are frequently called summable functions. The class of all 
such functions will be denoted by 8, and the functions them- 
selves will sometimes be denoted by the letter X. It was shown 
in the proof of the theorem that an integrable function X is finite 
almost everywhere. It is clear that the indefinite integral 


j^'Kdx is always absolutely continuous, and that the definition 
of uniform absolute continuity applies at once to sequences 
Xn dx^ of integrals of integrable functions. 

In order to justify the use of the sjunbol j^'XdXjWe should note 

that its value is independent of the choice of the fundamental 
interval I in which the set A is contained. Let /* be an interval 
containing I, and let the measure function m be defined on J* 
consistently with its values on J. Let be the characteristic 
function of A, and let (a„) be a sequence of step functions con- 
verging to X almost everywhere on J. Then (an<pj) converges 
to X^A almost everywhere on J*, and in this statement it does 
not matter what values are assigned to and X on I* — L 


Since 


an<l>A dx OLn4^± cfe, 
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it follows that the value of X dx is independent of the choice of 

the fundamental inten^al I containing A. 

*The preceding conditions are not satisfied in the following 
example. Let f{x) = x on 0 ^ a: g 1, f(x) = 2x on 1 < x ^ 2. 
Let I == [0, 1], /* = [0, 2]. Then the value of the interval func- 
tion m(7) obtained from the nondecreasing function / when 7* is 
the fimdamental interval is 2, but when I itself is the fundamental 
interval, m(/) = 1. 

It should be remarked that the class 8 of Lebesgue-integrable 
fimctions is not obtained, either from the class © of step func- 
tions or from the class ® of continuous functions, by taking the 
limits of sequences which converge everyv^here, even though 
this process is indefinitely repeated. Compare the references in 
Chap. VII, Sec. 5. 

fTHEOEEM 7. Suppose that (X„) is a sequence of integrdble 
functions converging almost everywhere to a function /i, and that the 
integrals 

(3:6) f^'Kdx 

are absolutely continuous uniformly with respect to n. Then y. is 
integrablej and the sequence (3:6) corwerges to j^ydx uniformly for 
sets A in S. 

*As before, the theorem holds also for general measure functions 
with the added hypothesis that y is finite almost everywhere^ or 
that the sequence (3:6) is uniformly hounded. 

Proof , — For every n there is a sequence (a&n) such that lim oLkn 

k 

== Xn almost everywhere, and such that the hypotheses of 
Theorem 6 are satisfied. Corresponding to a sequence of integers 
(A*„) let be denoted by By Theorems 2 and 6, for every 
n there exists a set Cn in ® and an integer such that 

m(C„) < 1/2”, 

\^{x) — X«(x)l < 1/2” on Z - Cn, 

(3:7) — j^\ndx]^< 1/2” for every set A in 31. 

As in the proof of Theorem 4, it follows that lim — Xn) = 0 
almost everywhere, and hence lim ocn = y almost everywhere. 
By hypothesis, for every positive e there exists a positive 8 such 
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that drc! < € for every n and every set A with m{A) < d. 
Thus by (3:7), we have 

(3:8) j^5nrfa:j<2€, 

whenever m{A) < B and l/2'‘ < e. Since onij' a finite number 
of values of n fail to satisfy the last condition, there exists a 
positive 5i ^ 5 such that (3:8) holds for all values of n provided 
only that m(A) < 5i. Thus the hj-^potheses of Theorem 6 are 
satisfied by the function jti and the sequence (5«), so that n is 
integrable, and the final conclusion of the theorem is obtained by 
use of (3:7). 

Theobem 8. Under the same agreement as in Theorem 5, 
the class 8 of integrable functions is closed with respect to the oper-- 
ations I, II, IV, and V, and in particular the absolute value of an 
integrable function is integrable. The product of an integrable 
function by an essentially bounded measurable function is integrable. 
Moreover, the integral is a positive linear operator on the dass 8. 

Proof . — ^The proof is like that of Theorem 6, except that now 
the preservation of the property of uniform absolute continuity 
under the operations in question must be verified. To show this 
for the operation IV of taking the logical sum, we note that 

(ai V a 2 ) dx = ai dx + ^2 dx. 

To show this for the operation of multiplying by a bounded 
function, let the integrals J^an dx he absolutely continuous 
uniformly with respect to n, and let the sequence be uni- 
formly bounded, \^{x)\ S K. Then if dxj < € whenever 

m{A) < B, UjOin^n db^ ^ whenever m{A) < 8. 

*For the case of a general measure function it is necessary 
also to verify the preservation of the property of uniform bound- 
edness of the integrals under the operations in question. 

The fact that the absolute value of an integrable function is 
integrable means that the Cauchy improper integral of ele- 
mentary calculus is not included as a special case of the Lebesgue 
integral. A discussion of nonabsolutely convei^ent int^rals 
may be found in Saks [1], Chaps. 6 to 8, or Hobson [3], Vol. I, 
Chap. 8. 
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Theorem 9. If \ is integrdble, there exists a sequence (otn) of 
step functions such that lim a* = X almost everywhere, and 

n=» » 

lim j lon — y] dx = 0. 

nsa a J 

Proof. — We can in fact prove that any sequence (an) used in 
the definition of J\dx satisfies the requirement stated. For, 
since 

j^\oc„-\\dx^ f\otn\dx+ f^\\\ dx, 

it is easily seen that the integrals on the left are absolutely 
continuous uniformly with respect to and then it is only 
necessary to apply Theorem 7. 

Theorem 10. If \ is an integrable function and n is a measur- 
able function such that \fi(x)\ ^ \(x) almost everywhere, then p, is 
also integrable. 

Proof . — Since by Theorem 8, ^ is integrable if and only if the 
functions ^ V 0 and p hO are both integrable, it is sufficient to 
consider the case when ^ 0. Let lim a„ = X almost every- 

n 

where, and let the sequence (on) satisfy the conditions of Theorem 
fi. Let hm — p almost everywhere, and let a„ ^ 0, a» ^ 0. 

n 

Set iSn = On A a«. Then lim Pn = p almost everywhere, and the 

n 

sequence (/Sn) satisfies the conditions of Theorem 6. 

As an immediate corollary of Theorem 8 we have the follow- 
ing useful criterion for the uniform absolute continuity of a 
sequence of integrals. 

Theorem 11. Let \q and each X» be integrable, and suppose 
that |X»(a;)| ^ Xo(a:) almost everywhere. Then the integrals 
are absolutdy continuous uniformly with respect to n. 

The following example shows that the hypotheses of Theorem 7 
may hold when there does not exist an integrable dominating 
function Xo(x) as described in Theorem 11. Let \n{x) = n for 
1/n ^ X S l/(n — 1), \n{x) = 0 for aU other values of x. Then 
'Kndx = l/(n — 1), and it is easy to verify that the integrals 

Xp dc are absolutely continuous uniformly with respect to n. 
However, l.u.b. \n{x) l/x, which is not integrable. A neces- 
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sary and suflScient condition that a family of integrals be abso- 
lutely continuous uniformly ’wtU be given in the next chapter. 

Another useful criterion for term-by-term integration of 
sequences is contained in the following theorem: 

Theorem 12. Let the sequence (Xn) of integrable functions be 
nondecreasing with respect to n, and let the limit of the sequence be 
denoted by jx. Then jx is integrable if and only if the sequence of 

integrals ^ bounded j and in this case 

(3:9) lim J^Kdx = J^/xdx 

uniformly for sets A in 5t. 

Proof , — If IX is integrable, we have \i{x) g \n(x) g so 
that 

j^\idx ^ j^Xidx ^ j^/xdxj 

and also (3:9) holds, by Theorems 8, 11, and 7. To prove the 
converse, we have pn = X^+i — X» ^ 0, and the series ^ j^ixndx 

n 

converges. Hence, corresponding to an arbitrary positive «, 
there exists an integer N such that 


(3:10) 2 

Since each integral J^'Kndx is absolutely continuous, we know 
that there exists a positive 5 such that 

(3:11) 

whenever n — 1, ‘ ‘ , N artd mi(A) < S. Then, when n > N 

and m(A) < S, we obtain by combining (3:10) and (3:11), 



ladx <2e. 


Thus the integrals X„ <& are absolutely continuous uniformly 
with respect to n, and the integrability of ji follows from Theorem 
7. 
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Still anotlier theorem which is sometimes useful may be 
derived from the precedmg results. 

Theoeem 13. Let Xo and Xn be integrable, and suppose that 
lXn(a:)l S Xo(a;) almost everywhere. Then the functions 

^(x) = lim inf 6(x) s lim sup \n(x) 

are integrable, and for every set A, 

(3:12) L Ip dx ^ lim mf j^'Kndx ^ lim sup J^Xndx 

— A ^ 

Proof , — Let Unpix) = l.u.b. Xnix) for n ^ p, v^ix) = 
lim Then each iinp is integrable, by Theorem 8, and 

Pft and Q = lim Vn are integrable by Theorems 11 and 7. Also 

= Ja jUnp dx ^ J^Vndx 

for n ^ m ^ p, by Theorem 8, and hence lim sup f X^dx 
C 

= JA every n. The right-hand inequality in (3:12) 

follows by another application of Theorem 7. The left-hand 
inequality may then be obtained by applying the right-hand 
inequality to the sequence (—Xn). 

fTHEOREM 14. Let p be a bounded Riemann-’integrable func- 
tion, Then p is also integrable in the sense of Lehesgue and the two 
integrals of p have the same value. 

Proof . — ^We shall use the criterion of Chap. VI, Theorem 7, 
that p is Riemann-integrable only if it is continuous almost 
everywhere on I, Take a sequence (P„) of partitions of I, with 
norm tending to zero, and let 


S{Pn) = ^ 


be the value of a Eiemann sum associated with P». Let 




where <^i, is the characteristic fxuiction of the interval i*. Then 
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S(Pii) = f a„dx, and since lim an(x) = \l/{x) at every nt <, 

where ^ is continuous, the desired result follows from Theorem 3. 

*The arguments of Chap. YI, Sec. 1, are extensible without 
much change to the case of functions f{x) of k variables, defined 
and bounded on the fundamental interval 7, pro\dded the par- 
titions of 7 are restricted to those obtained by partitioning each 
axis. Then the argument used in pro\ing the last theorem 
applies at once in this case, and is extensible also to the case 
when the partitions P of 7 are partitions into a finite number of 
measurable^ sets and the norm N(P) is the maximum diam- 
eter of a set Eh of the partition. This shows that the same result 
is obtained in defining the multiple Riemann integral when only 
the restricted type of partitions is admitted, as when a more 
general type is used. 

fFrom Theorems 14 and 4 it follows that, if a bounded sequence 
of Riemann-integrable functions converges to a Riemann- 
integrable function, the corresponding sequence of integrals 
converges to the integral of the limit. This result was first 
proved by Osgood^^^ without use of the Lebesgue integral. 

4. Measurable Sets and Ftmctions. — A set E is said to be 
measurable in case its characteristic function is a, measurable 
function and, by definition, 

(4:1) m(E) = ^ 

We shall let (S denote the class of all measurable sets E. 

A class ^ of subsets of the interval 7 is said to be additive in 
case it contains (a) the sum of every denumerable family of sets 
in (6) the complement of every set in (c) the null set. Such 
a class ^ is sometimes called completely additive, in contrast to 
the finitely additive classes in whose definition (a) is replaced by 
(a') the sum of every finite family of sets in Every additive 
class is evidently also closed with respect to the operations of 
taking differences and denumerable products. The property of 
being additive is extensionally attainable in the class Q of all 
subsets of 7, by Lemma 9 in Sec, 3. The extension of the cla^ 

1 The notion of measurable set is defined in Sec. 4, 

* ^^Non-uniform Convergence and the Integration of Series Term by 
Term,” American Journal of MathemcUicSf Vol. 19 (1897), pp. 155-190, In 
this memoir all the functions are supposed to be continuous. 
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of subinten^als of J to be additive is called the class of Borel- 
measttrable sets. Every open set is Borel-measurable, and so is 
every closed set. 

Theorem 15. The class (S of measurable sets is additive. If 
the sets of the sequence (En) clts disjoint and measurable^ we have 

I! m(En). 

The proof is based on Theorems 5 and 4. From the final 
statement of the theorem it follows that the definition of measure 
given in formula (4:1) is consistent with the definition previously 
given for sets in S. It is clear also that sets of measure zero 
may be disregarded in considering the measurability of a set E, 
Theorem 16. For an arbitrary sequence (En) of measurable 
sets, we have 

m(lim mf En) ^ lim inf m(En) ^ lim sup m(En) 

^ m(lim sup En)- 

Proof. — Let S = lim inf S = lim sup En- Then 
== lim inf == lim sup 

where 4> denotes the characteristic function. Hence the theorem 
follows from Theorem 13. 

Theorem 1 7. For every measurable set E and every 'positive e 
there exists a set C in ® and a set A in % such that m(C) < e and 

(4:2) A-CCECA+C. 

Proof, — ^Let (ocn) be a sequence of step functions converging 
to the characteristic function 4>e almost everywhere. Then by 
Theorem 2, lim an = 4 >e almost uniformly, so that there exists 

n 

a set (7 in S and an integer k such that m(C) < e and \ah(x) 

— <I>e(x)\ < i on the complement of C, If we now let A denote 
the set of points where ak(x) > f, we find that (4:2) is verified. 

Corollary. If E is measurable, then 

m(E) = g.Lb. m(Gf) for all open sets G ^ E 
= Lu.b. m(F) for ail closed sets F C E, 

C adversely, when g.l.b. m(G) = Lu.b. m(F), then E is measurable. 
Proof, — Since m(A — C) + m(C) = m(A + C), we have m(A 

— C) > m(E) ~ €, m(A + C) < m(E) + e. By (2:1), the set 
C may be supposed open. Also there is a closed set Ai and an 
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open set A 2 such that Ai C A C A2,m(*4i — C) >m{E) — e, 
7n{A2 “i" O ^ 7n{E) €. 

From the above it follows that, when m(E) = 0,E must be a set 
of measure zero as defined in Sec. 2. To prove the last part of the 
corollary, let ((?») be a nonincreasing sequence of open sets such 
that lim m(Gn) = g.l.b. in(G), and let (Fn) be a nondecreasing 
sequence of closed sets such that lim m(Fn) = l.u.b. m{F). 

Then by Theorem 16, m (n = lim miGn), m 

= lim m(F»). But 11 ^ so m 

= m ““ i?) = 0. Thus E is measurable since it differs 

from Y[Gnhy 2i> set of measure zero. 

*The corollary suggests another notion that is occasionally 
useful — ^that of exterior measure. For an arbitrary set E we 
define the exterior measure me{E) by the formula 

nieiE) = g.l.b. m{G) for all open sets G ’2) E. 

We note that for a measurable set the exterior measure coincides 
with the measure. It follow's that an arbitrary set j® is included 
in a product (?a of a sequence of open sets such that me{E) 
= m(Gs)- By use of this fact we can obtain the following partial 
extension of Theorem 16: 

*Theokem 18. For an arbitrary sequence of sets En, we have 
m«(lim inf En) S hm inf meiEn)^ 

If X is integrable and E is b, measurable set, it follows from 
Theorem 8 that 'K4>e is also integrable. Thus the definition 

(4:3) fi ^ 

is valid, and we may regard the integral as a function of measur* 
able sets. The next two theorems show that it is an additive 
function which is also absolutely continuous. 

Theorem 19. Let X be integrable and let the sets of the sequence 

(En) be measurable and disjoint. Let E = ^ En* Then 


(4:4) 
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Proof . — ^We have 

n n 

\<j)E = lim ) = \M} 

n 

SO that the formula (4:4) follows from Theorems 11, 7 j and 8. 
We have already noted, following Theorem 6, that when X 

is an integrable function, j^\dx is absolutely continuous as a 
function of sets A in SI. This property extends readily to 
\dx Bs SL function of measurable sets E, as follows from the 
next theorem. 

Theorem 20. Suppose that X is integrable and that ] X drrj 
g € whenever m{A) < 8. Then 

\J^\dx\^e, f^\\\dxi2e, 


for every measurable set E with m(E) < 5. 

Proof . — From Theorem 17 it follows that there is a sequence 
(J.«) such that lim = 4>b almost everywhere, and lim m{An) 

n n 

= m{E). Then lim X<^^„ = \4>e almost everywhere, and by 

n 

Theorems 11 and 7, 

r \dx ^ f\ dx. 

n jAn JE 

Also 

f^mdx = f^Xdx - f^\dx, 


where \(z) ^ 0 on and X(a:) ^ 0 on E 2 . 

Lemma 12. The following conditions on a function yj/ are all 
equivalent: 

(a) For every finite number c the set E[}l/ > c] is measurable; 

(b) For every finite number c the set E[yp ^ c\ is measurable; 

(c) For every finite number c the set E[yl/ < c] is measurable; 

(d) The set E[yl/ = + «? ] is measurable, and for every pair of 

finite numbers c and d the set E[c ^ < d] is measurable. 

Proof.— The proof is based on Theorem 15. To show that 
(a) implies (6), we note that 

E[i^ c] — JJ E[^ > c — 1/n]. 
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Since E^/ ^ c] and E[ip < c] are complementary sets, (6) implies 
(c). To show that (d) implies (6), we note that 

E\}1> ^ c] = E[4i = + 00 ] + ^ E[c + ng^<c + n + l]. 

n=0 

It is clear that other equivalent conditions are obtainable from 
(b) and (d) by reversing the direction of the inequalities and by 
changing + co to — <» in (d). 

The class of all functions rp satisfying the conditions of Lemma 
12 will be denoted by 91. In Theorem 21 below it is shown that 
the class 91 is identical with the class 3K of all measurable func- 
tions. The proof depends on the following closure property of 
the class 91. 

Lemma 13. Let (\pn) be a sequence of functions in 9^. Then the 
following functions: 

l.u,b. ypnj g.l.b. lim sup lim inf 

are all in 9i. 

Proof , — ^Let ^ = l.u.b. 4^^. Then E[4f > > <?]• 

Thus ^ is in 91 by Theorem 15. The remainder of the lemma is 
proved in a similar way. 

Theorem 21. The class 91 is identical with the doss 2R of 
measurable functions. 

Proof . — It is clear that every step function a is in the class 91, 
and a fimction equal almost ever3r9v'here to a function in the 
class 91 is likewise in the class 91. Hence 3)i C by Lemma 13. 
Now let ^ be an arbitrary function in 91, and let 4>nk denote the 
characteristic function of the set E[k/n ^4^ < {k + l)/n], 
the characteristic function of the set E[4 ^ n], and the char- 
acteristic function of the set E[ip < —n]. Each of these func- 
tions is in 2)i, by the definition of the class 9t and of measurable 
sets. The function 

/Xn = \ 

is a linear combination of functions in Wt and so is in 90?, and 
thus 4^ = Ihn fin is also in 90? by the corollary of Theorem 4. 
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The class 93 of all functions satishung the conditions of Lemma 
12 when the term “measurable’’ is replaced by “Borel-measur- 
able” is called the class of Borel-measurabie functions. It is 
e'V’idently always a subclass of the class 5Di. It coincides with 
the sum of the classes of Baire described in Chap. \ II, Sec. 5.'^' 
For a proof that there exist nonmeasurable functions, as w^'eU as 
functions in the class 2)2 — 93, see IMcShane [2], pages 237-241. 

Theorem 22, Let the measurable function jx be finite almost 
everywhere and let e be an arbitrary 'positive number. Then there 
exists an open set C in S such that m(C) < € and the section of p 
defined on the complement of C is continuous. Hence there exists a 
function ^ continuous on the interval I and identical with p on the 
complement of C. 

Proof. — ^Let o: be a step function, and consider an interval i 
(degenerate or nondegenerate) on w’hich a. is constant. If i does 
not consist of only one point, let B denote the boundary of and 
choose a closed subinterval fo of i such that i — u is contained 
in the neighborhood N{B] e). When i reduces to a single point, 
take io = i. Set yi{x) = a{x) on each such zo, and extend 
to be continuous. Let denote the sum of the closed subinter- 
v^als io. Then if lim en == 0, lim (I — AeJ = A, and so lim m{I 

n n n 

— = 0, by Lemma 8. Hence the theorem holds for step 

functions. 

Now let (an) be a sequence of step functions such that lim an 

n 

= p almost everywhere. Then by Theorem 2 there exists a set 
Cl in ® such that m(Ci) < e/2 and lim an = p uniformly on 

n 

J — Cl. The set Ci may clearly be required to be open. By 
the first part of the proof, for each n there is an open set An 
such that m(J!n) < and the section of an on I — An is 

continuous. Let C = Ci + ^ iin. Then m(C) < e, the section 
of each an on Z — C is continuous, and lim an — p uniformly on 

n 

I — C. Hence the section of ^4 on Z — C is continuous. The 
final statement in the theorem follows from Theorem 21 of 
Chap. VII. 

^See Lebesgue, “Sur les fonctions repr4sentables anaJytiquement,” 
Journal de matMmaiiques (Series 6), Vol. 1 (1905), pp. 139-216, especially 
pp. 156-165. 
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Two theories of integration are said to be consistent if they 
yield the same class of integrable functions wdth the same 
value for the integi’al of each. It is not diflScult to show that, 
if two theories have the same measure for intervals and, in each, 
formula (4:1) holds for interv^als, the integral is a linear operator, 
and Theorems 4, 12, 15, and 22 hold, then the two theories 
are consistent. For then the measure of open sets is the same 
in both, and sets of measure zero are the same for both. By 
Theorem 22 the class of measurable functions finite almost every- 
where is the same for both. The integrals of step functions 
and of continuous functions are the same for both, and hence the 
integrals of bounded measurable functions are the same for both, 
by Theorem 4. By Theorem 12 we proceed to the same result for 
the class of all integrable functions. 

In particular, our theory is consistent -mih that originally 
developed by Lebesgue. Also, a consistent theory is obtained 
by starting from the class of continuous functions in place of the 
class of step functions. 

fS. Differentiation of Functions of One Variable. — In the 
remainder of this chapter we restrict attention to functions of 
one variable and to the case when the measure of an interval 
is its length. The proof given for Lebesgue’s theorem on the 
existence of a derivative (Theorem 27) is due to Riesz [9]. An 
especially simple proof is given of the fundamental theorem of 
integral calculus for Lebesgue integrals (Theorem 29). 

*For more general theorems on the differentiability of func- 
tions of one variable, the reader is referred to Hobson [3], VoL I, 
pages 391-404, and references there. Extensions of some of the 
results of this section to functions of several variables may be 
found in the standard treatises on Lebesgue integrals. See, for 
example, Saks [1], Chap. 4, and Hobson [3], Vol. I, pag^ 607-616. 

Letf(x) be a single-real-valued fimction defined on the interval 
I = [a, &], and let P be a partition of / by points a:/, where 
a = Xo < xi < * * • < Xn-i < ar» == &. Let 

X 

(5:1) . V^ix) = 2 

a 

where the sum is taken over those intervals of the partition P 
which are contained in the closed interval [a, x]. Let Vpix) 
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denote the sum of those terms in (5:1) for which the increment 
[/(a:i 4 .i) — fixj)] is positive, and let Vp{x) denote the sum of 
those terms in (5:1) for which the increment is negative. Let 
t{x), p{x), n(x), denote the least upper bounds of Vp(x)j Vp{x), 
Vp{x), respectively, for all partitions P. The functions t{x), 
p{x), n{x), are called the total variation, positive variation, and 
negative variation, respectively, of f{x) on the interval [a, x]. 
When tQ>) is finite, the fxmction /(x) is said to be of bounded 
variation (or of limited variation) on [a, 6]. 

Theorem 23. The class of all functions of hounded variation on 
[a, b] is closed with respect to the operations I to V of Sec. 3. 

Theorem 24. A function f(x) is of hounded variation on [a, 6] 
if and only if it is expressible as the difference of two nondecreasing 
bounded functions. A function of bounded variation has one-sided 
limits at each point and has at most a denumerable infinity of 
discontinuities. The discontinuities of f{x) are the same as those 
of tix). 

Proof. — It is clear that p{x) and n{x) are nondecreasing and 
that, when f{x) is of bounded variation, 

Six) = /(a) + p(x) - nix), 
tix) = vix) + nix), 

since a sequence of partitions P* may be chosen such that we 
have simultaneously for the corresponding sums, 

lim Vp ix) = p{x), lim Fp (re) = n{x), lim Fp (re) = t{x). 

h k * k 

A nondecreasing boimded function is plainly of bounded varia- 
tion, and the class of all functions of bounded variation is linear, 
by Theorem 23. The existence of the one-sided limits of f(re) 
follows from Theorem 2 of Chap. IV. For a finite number of 
discontinuities Cj of the nondecreasing function p(re), we have 

^ Ipici + 0) - pic, - 0)] ^ pib) - pia). 

Consequently, for each k only a finite number of jumps'' 
[picj + 0) — p{cj — 0)] can be greater than 1/k, and thus it is 
seen that the set of points of discontinuity must be either denum- 
erable, finite, or null. To show that when f(x) is continuous 
on the right at a point Xq, t{x) is so also, select a partition P 
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such, that t{h) — Vp(b) < We may require the points xo and 
X to be partition points, \vith x > Xo- Then 0 ^ t{x) — iCxj) 
— lFp(a:) — Fp(a:o)l < «, and when x is sufficiently near xs, 
Vp{x) - Fp(a;o) = l/(x) - /(a:o)i < e, so that r;x) - ..rj < 2«. 

Let A denote the sum of the unite Lamoer of nonoveriapping 
subintervals {a.-, &,) of ia, 6j, and let 

3 

The fxmction f{x) is said to be absolutely continuous on [a, b] 
in case 

lim f[A] = 0. 

It is important to note that for an absolutely continuous function 
/ we have also 

lim y 1/(6,) - /(a,)| = 0. 

mU)=oy 

Theoebm 25. The class of dll functions absolutely continuous 
on [a, 6] is closed with respect to the operations ItoY of Sec, 3. 

Theorem 26, If f{x) is absolutely continuous on [a, b], then 
f{x) is of bounded variation on [a, 6]. 

It is easy to construct examples of functions that are absolutely 
continuous, and hence of bounded variation, on a finite interval 
[a, &]. The simplest of these is f(x) = x. From Theorem 25 
it follows that all polynomials in x are absolutely continuous. 
If |/(d) — /(c)l ^ \g{d) — g{c)\ for every subinterval (c, d), and 
g(x) is absolutely continuous or of bounded variation, then f(x) 
has the corresponding property. In the special c^ where gix) 
= Kx^ f{x) satisfies a Lipschitz condition. By the Theorem 
of the Mean for derivatives, if f{z) has a derivative everywhere 
which is bounded, then f{x) satisfies a Lipschitz condition. 
Hence the function f(x) = x^ sin (l/x), with /(O) = 0, is abso- 
lutely continuous. But the function fi(x) = x^ (lA), with 
/i(0) = 0, is not of bounded variation on the interval [0, 1], as 
may be shown by using the points z = 2/ (2n + l)ir as partition 
points. An example is given following Theorem 29 of a func- 
tion that is nondecreasing and continuous but not absolutely 
continuous. 
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Tha next lemma is due to Riesz [9]. 

Lemma 14. Let the function g(x) be bounded on [a, 6], and set 
G(x) = lim sup g(x'). 

x‘—x 

Let E denote ike set of all poinuS x of the open interval a < x <b 
such that there exists a point xi> x with g{xi) > G(x). If E is 
not null, it is an open set and, if ^ (a*, 6i) is the representation of 
E as a sum of disjoint open intervals, then g{x) ^ 0{bj^ on the 
interval (ak, bk), for every h 

Proof, — It is easy to verify by an indirect prooi that tiie 
function G{x) is always upper semicontinuous, and from this 
property it follows at once that the set E is open. Then the 
representation of i? as a sum of disjoint open intervals is unique, 
as was indicated in Lemma 5. If a; is a point of the open interval 
(a*, bk), let X 2 denote the least upper bound of the set of points xq 
of the closed interval [x, bk] for which g{x) ^ G{xo), Then on 
accoimt of the upper semicontinuity of G, 

(5:3) g{x) ^ Gixz), 

and, if 0:2 = bk, this is the desired result. But, if X 2 < bk, by 
the definition of the set E there exists a point xi > Xz such that 

(5:4) g(xi) > G{x 2 ). 

Then G{xi) > g{x), and xi > bk by definition of X 2 , Since 6* is 
not in the set E, 

(5:5) g(xi) g G(bk), 

and by combining (5:3), (5:4), and (5:5) we have the desired 
result. 

The four principal derivates or derived numbers of a function 
f(x) were defined in Chap. V, Sec. 1. 

Lemma 15. The following relations between derivates hold for 
an arbitrary function f: 

(6:6) i)+(-/) = -D+/, D-{-f) = -D.f; 

ify= —X, g(x) - —f{y), then 
(5:7) D^gix) = D^f{y), 


D+g{x) = D4{y\ 
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Proof. — The relations (5:6) follow from the relation Lu.b. 
[“'/W] = "“g-l-b. fix). The relations (5:7) follow from the 
formula 

g(x + k) - g(x) ^ fjy - h) - fjy) 
h -k 

Theorem 27. If fix) is of hounded variation on [a, h] then f(x) 
has a finite derivative almost everywhere on [a, b]. 

Proof. — By Theorem 24 it is sufficient to consider the case 
when fix) is nondecreasing, so that each derivate Df is every- 
where nonnegative. I^et Ea denote the set including the dis- 
continuities of fix) and the end points a and b, so that Eq is 
denumerable and hence of measure zero. Let 

Se = E[D-^f > Rl Tr - EID4 < r]. 

We shall show first that Sb Eq is contained in a set iJi, where 
miEi) approaches zero with 1/R, so that D^f is finite almost 
everywhere. Then we shall show that, whenever 0 < r < R, 
SrTt — Eqis contained in the product of a nonincreasing sequence 
of sets En whose measure tends to zero, so that miSETr) = 0. 
Let giiz) — fix) — Rx, and let Giix) and Ei = ^ (a/, fe/) 

correspond to giix) as in Lemma 14. Then, since (?i(x) = giix) 
except possibly on Eq and since for each point a; in & there 
exists a point Xi > x such that fixi) — fix) > Rixi — x), it 
follows that 

(5:8) Sb — Eo C. El. 

Now since fix) is nondecreasing, by Lemma 14 the set Ei has the 
property that giiaj + 0) g giibj + 0), or 

(5:9) Ribs - a,) ^ fibs + 0) - /(a,- + 0). 

From this it follows that 

RmiEi) ^fib) - /(a). 

Since by (5:8), E[D-^f = oo] C for every R, it follows 

that 2>+/ is finite almost everywhere. 

Now let g 2 iy) = fi-y) + ry, and let Gtiy) correspond to 
g 2 iy) as in Lemma 14. Since / is nondecreasing, 

G 2 iy) = fi-y + 0) + ry^ g^iy - 0). 
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Let the set ^ (— &)•*, — Oji) be the set defined in Lemma 14 

k 

f or the int-erval (—6;, —a^), so that^ 2 (— — 0) ^ g^i’-hjk + 0), 
or 

(5:10) rQ)ih — OjTb) ^ /(&/* — 0) — /(a/* + 0), 
and the set 

(5:11) SrTt “ ^0 C -^2 = ^ 

Now apply the process by which (5:8) and (5:9) were obtained 
to each inter\^al (a/*, &/*), noting that in this process /(^y* + 0) 
may be replaced hj f(bjk — 0). We thus obtain 

(5:12) SbTt — Eo d Ez ^ {djkh hhi)y 

jkl 

(5:13 R(biki — u/h) ^ /(^yw + 0) -- fidjki + 0), 

where in (5:13), f(bjki + 0) is to be replaced by f{bjki — 0) 
whenever bjki = bjk- 

By alternating applications of the two processes we obtain a 
nonincreasing sequence of open sets En such that 

(5:14) SsTr — jBo C Enj 

RmiEz) ^ I miki + 0) ~ fioiu + 0)1 

-/(a,-, + 0)] 

3k 

^ rm{E^ ^ rm{Ei), 

and in general 

(5:15) m(J?2n+i) ^ {T/RYm{E,). 

If we now assume that 0 < r < R, we find from (5:14) and 
(5:15) that m(SiiTr) = 0. Since 

^[Z)+/ >!)_/] = 

where the sum is takea over rational values of r and E for which 
0 < r < jB, it follows that 


(5:16) 


i)+/ ^ D-f 
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almost everywhere. From (5:7) and (5:16) it follows that 
(5:17) D-f ^ D4 

almost everywhere. By combining (5:16) and (5:17) with the 
obvious inequalities D^f ^ D~/, D^f g D-^f, we obtain the 
desired result that the four derivates are equal and finite almost 
ever3r^v^here. 

t6. The Fundamental Theorem of Integral Calctilus. — In 
Theorems 28 and 29 below we find extensions of Theorem 10 of 
Chap. VI which are made possible by the concepts of Lebesgue. 
We shall need the following simple preliminary result: 

EMMA 16. If X is an iniegrable function such that \dx — 0 
on [a, 6], then X = 0 almost everywhere on [a, b]. 

Proof . — ^Let (an) be a sequence of step functions converging 
to X almost everyv^here, and satisfying the conditions of Theorem 
6. Then for every k there exists an integer n* such that 



< 


1 

22*+i 


for an arbitrary set A in %. Hence \ar,i,{x)\ < (i-)* except on a 
set Ak with m(A&) < (i)*, so that lim On* = 0 except on a set E 

k 

00 

contained in each of the sets Cp— Ak. Since m(€p) < (i)^S 

k^p 

it follows that m(E) == 0, and hence X = 0 alhiost everywhere. 

Theorem 28. If f(x) is absolutely continuous on [a, 6] then 
its derivative f{x) is iniegrable on [a, 6], and 

jjfdx= fix) - /(o). 


Note: The validity of this and following theorems involving 
derivatives is not affected by the fact that the derivative f{x) 
may fail to exist on a set of measure zero. 

Proof.— 'Fox X > bsetfix) = fib) and for x < aset/(x) = /(a). 
The fimction 


X(x, h) = 


f(x + h) -fix) 
h 


is integrable for A 5^ 0, since fix) is continuous. For an arbi- 
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trary set .4 = ^ (aj, 6/) we have 

[/. 

^u:i 


\ix, ^ ^ 


fix) dx- f 
a}-^h J O; 

r rhi^h r 

[L 


fix) dxj 

a,+h 1 

fix) dx 


{fihj + rc) - /(% + x)] dx. 


Since the intervals (a/ + x, 6/ + a:) are nonoverlapping and the 
function / is absolutely continuous, it follows that the integrals 

'Kix, h) dx are absolutely continuous uniformly in h. Also 
lim \ix, h) = fix) almost everywhere, so that by Theorem 7, 

f(x) is int^grable and 





Theorem 29. If X is a function integrable on [a, 6], there exists 
a function f such that (i) / is absolutely continuous on [a, &] ; (ii) 
the derivative f{x) = X(x) almost everywhere on [a, 6], For every 
function f satisfying conditions (i) and (ii) we have 

f\dx = fib) - fia). 

Proof . — ^If we set fix) = \dx, then f is absolutely continu- 
ous by a remark following the proof of Theorem 6. By Theorem 
28, l^if-\)dx = 0, SO that /' = X almost everywhere by 
Lemma 16. The last statement in the theorem also follows from 
Theorem 28. 

It is now clear that, for functions of one variable, the Lebesgue 
integral is characterized descriptively by the conditions (i) and 
(ii) of Theorem 29, This descriptive approach to the integral 
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follows the ideas of Newton, while the constructive approach of 
Sec. 3 is related to the ideas of Leibnitz Cauchy, and Riemann. 
Certain relaxations of the conditions ,1} and ‘ii) are possible, 
leading to the integrals of Dcnjoy. (See Saks [1]. Chaps. 7, 8.) 
However, the condition (i) cannot be omitted entirely without 
losing the uniqueness of the integral. In fact a nondecreasing 
continuous function can be constructed whose derivative is zero 
almost ever^^’here but which is not a constant.’ Let the 
fundamental interval be [0, 1] and let x be represented in the 
ternarj^ system, while f{x) is represented in the binary system. 
If the digit 1 first appears in a certain place in the representation 
of Xf let the corresponding digit of /(x) be 1 while all the follo\\ing 
digits are 0. For all other places, let a 0 in the representation of 
X correspond to a 0 in the representation of /(x), and a 2 in the 
representation of x correspond to a 1 in the representation of 
f(x). It is easily seen that f(x) is continuous and nondecreasing, 
that its derivative is zero on the complement of the Cantor set F 
of Chap. Ill, and that the measure of F is zero. 

The need for some part of the condition (i) is also emphasized 
by the existence of infinite families of functions such that all 
the functions of a family have the same derivative, but no two 
of them have a constant difference. See the remark following 
Theorem 4 in Chap. V. 

The next theorem includes a formula for the total variation 
of an absolutely continuous function of one variable. 

Theorem 30. If f(x) is of hounded variation, its derwatwe 
f{x) is Lebesgue-integrable, and its total variation t{x) saiisfies the 
inequality 

(6:1) tQ>) ^ |/'(a:)l dx. 


The equality sign holds if and only if f is absolutely cmiinuous. 

Proof. — ^Following the notations of Sec. 5, we have f{x) = /(o) 
+ p(x) - n{x), t{x) = yix) + n{x), and so/' = p' - = p' 

+ n', j/'l ^ almost everywhere. Let 


f^{x, h) = 


i{x + h) — t{x) 

, 


where it is understood that the definition of i(ar) is extended 


^ See Bliss [10], p. 45. 
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by constant values outside the interval [a, 6], and let yl/{x, h, n) 
= h) A 72 . Then lim \f/(x, h, n) = t^x) A n almost every- 

where. Also h, n) is integrable with respect to x, and 
bounded vdth. respect to x and h, and 


j ^(x, h,n) dx 


{t{x + K) — i(a;)] dx 


t{x) dx 


r a+A “J 

t(x) dx U 
a j 


and hence 


[fix) ^n]dx^ t(b) - t{a + 0). 
Hence by Theorem 12, t\x) is integrable, and 
i'{x) dx g t{b) - t(a + 0). 


It is clear that we may replace t{b) by t(b — 0). When t(b) 
= t'{x) dx, we have also t{x) = t'(x) dx, and hence t(x) is 

absolutely continuous, and so are plx), n{x), and/(a;). 

To prove that, when / is absolutely continuous, the equality 
sign holds in (6:1), we note that there exist two nonnega- 
tive integrable functions Xi and X 2 such that /' = Xi — X 2 , 
\f\ = Xi + X 2 . Then the functions gi{x) = Xi dx and g 2 (x) 

= X 2 dx are nondecreasing, and by Theorem 28, f{x) = /(a) 
+ — ff 2 (x). Hence in this case 

m ^ giib) + ^2(6) = f' l/'l dx. 


*The notion of the metric density of a set at a point is occa- 
sionally useful. The result below on the metric density of a 
measurable set in one-dimensional space is included here since 
it is an immediate corollary of Theorem 29. More general 
definitions and theorems, applicable in spaces of more dimensions, 
are given in Saks [1], pages 128/., and in Hobson [3], Vol. 1, 
pages 190/. 

*If J? is a measurable set and a:© is an arbitrary poiut in one- 
dimensional space, and 
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(6-2) 


lim ^ 


exists, where the interval i is required to contain the poiai xq, 
then the value of (6:2) is called the metric density of E at xq, 
*Theorem 31, A measurable set E has metric density 1 almost 
everywhere on E, and metric density 0 almost everywhere on cE. 

Proof , — Since m(iE) = j. (hsdXj where is the characteristic 
function of E, and since 


m -fM _ 

P - a 


1 

jS a 


[ 


(xo — a) 


f(xo) - /(«) 

Xo a 


p — Xo J 


it is clear that the limit (6:2) exists and equals the derivative of 
(6:3) fJ<l>Bdx 


at all the points xo where (6:3) has a derivative and at no others. 
So the theorem follows from Theorem 29. 

*7, Rectifiable Curves. — set of k continuous functions 
« 

(7:1) yi = yi(u)j i = 1, • • • , i*; a g w g 6, 


constitutes a representation or parametrization of a continuous 
path curve C in fr-dimensional space. The variable u is called 
the ‘^parameter of the representation,” and the path C is said 
to be traversed in the direction of increasing u. Such a repre- 
sentation may have ‘‘intervals of constancy” [u', u”] on which 
all the functions yi are constant. 

An admissible change of parameter is determined by a function 


u = B{v\ € ^ V ^ dj 

such that (1) $ is nondecreasing; (2) 6(c) = o, B(d) = b; (3) every 
discontinuity [^(t? — 0), B(v + 0)] is contained in an interval of 
constancy [u', u"]. Such a change of parameter may eliminate 
some intervals of constancy and introduce others. It is easily 
seen that, if = B(v) is an admissible change of parameter for 
the representation yi(u)j then the inverse function v = 
(properly defined) is an admissible change of parameter for the 
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representation yi{S(v)). Two representations are said to be 
equivalent if it is oossible to pass from one to the other by an 
admissible change of parameter. This equivalence relation is 
transitive. Thus we may dehne a continuous path curve C as a 
maximal class of equivalent representations in the form (7 :1). 

A partition P of the interval a ^ u ^ h determines an inscribed 
polygon Tr(P) formed by joining the points corresponding to 
successive parameter values. The length L(t(P)) of such a 
polygon is defined in the usual elementary way. The length 
L(C) of the curve C is defined to be the least upper bound of 
L(ir(P)) for aU partitions P. When L(C) is finite, the curve C 
is said to be rectifiable. The length of a curve is obviously 
independent of the choice of the representation. 

Theorem 32. A curve C is rectifiable if arid only if the func~ 
tions yi{u) representing it are of hounded variation. 

This follows from the inequalities 

X iA^il g L{-r{P)) g J J \^v,\, 

P i P 

which hold for each coordinate yi. Here ^ \Xyi\ means ^ \yi{un) 

P n 

— yi(un-i)\j where Un ranges over the partition points of P. 

Theorem 33. For every continuous curve C, 

L{C) = lim L{t{P)), 

iV(P)=0 

Proof . — Let Po be a partition of [a, b] by points Ui, 
and suppose that i(ir(Po)) = Lq. Suppose that \yi(u) — yi(uj)\ 
< e whenever \^i — Uj\ < d. Let P be a partition with norm 
iV’(P) < 5, and let the partition P* be formed by using the parti- 
tion points of both Po and P. Then 

Lo ^ L(ir(P*)) ^ L{ir(P)) + 2]cq€. 

Since the curve C is continuous, the desired conclusion may 
readily be obtained from this inequality, whether L{C) is finite 
or infinite. 

It is easily verified that a curve C is rectiSable if and only if 
every subarc is rectifiable, and that the length of the whole is 
the sum of the lengths of the parts. When C is rectifiable, the 
length s{u) of the piece corresponding to the parameter interval 
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[a, u] is a nondecreasing continuous function. Its inverse func- 
tion u = B{s) satisfies the conditions for an admissible change of 
parameter. Hence every rectifiable curve may be represented 
^^ith the arc length s as parameter. With this representation the 
functions yi{s) satisfy a Lipsehitz condition, and hence are 
absolutely continuous. 

Theorem 34. For an arbitrary representation (7 :1) of a 
rectifiable curve C, we have 


(7:2) 

(7:3) 




du. 


The equality sign holds in (7:3) if and only if the functions yi(u) 
are absolutely continuous. 

Proof . — Since 


(7:4) 



it follows that 



% 


whenever aU the derivatives involved exist. Let E denote the 
set of all points u at which the strict inequality holds in (7:5), 
and let Eq denote the set of all points umE such that 



whenever the interval Au contains u and has length less than 1/q. 
Then E = '^Eq, and (7:2) will follow if we show that m{Eq) = 0 
for each q. Let e > 0, and let P be a partition with N{P} <,\Jq 
and 

(7:7) L(t(P)) >L(C)--€. 

If we multiply (7:6) by Au and sum over the intervals of P 
containing points of and add to this the sum of (7 :4) over the 
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remaining intervals of P, we find that 

(7:8) LiO Lfr(P)) + 

From (7:7) and (7:8) we obtain m{E^ < eg, and hence m{E^ = 0. 

It follows readily from its definition that the function s{v) is 
absolutely continuous if and only if all the functions yi{u) have 
that property. Thus the remainder of the theorem follows at 
once from Theorem 30. 
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CHAPTER XI 

THE LEBESGUE INTEGRAL {Cmtinue^^^^ 


1. Differentiation with Respect to a Parameter 

fTHEOREM 1. Let \(x, t) be defined and integraUe with respect 
to X on the fundamental interval 1 for each t in a neighborhood of /o, 
and let the partial derivative ^o) exist almost everywhere on L 
Let the integrals 

f to h) — \{Xy U) 

Ja h 

be absolutely continuous uniformly with respect to h. Then the 
function 



has a derivative at U, and 



This theorem follows at once from Theorem 7 of Chap. X, 
and holds for an interval I in any finite number of dimensions. 
It holds also for a general measure function with an added 
hypothesis similar to the one following Theorem 7. We recall 
that a sufficient condition for uniform absolute continuity is 
given by Theorem 11 of Chap. X. In particular this condition 
is always satisfied when the difference quotients [X(a;, fe + A) 
~ \{x^ io)]/A are uniformly bounded. 

2. Fubini’s Theorem on Reduction of Multiple to Repeated 
Integrals —In order to prove Fubini's theorem (Theorem 2) on 
the reduction of a multiple integral to repeated integrals, we 
shall need some preliminary definitions and theorems. The first 

^ We continue to indicate with a f those theorems which are not 
known to hold in unrestricted form for a general measure function. 
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of these is related to Lemma 16 of Chap. X, and in the one- 
dimensional case is a corollary of it. 

Lemma 1. Let \be a nonnegatwe integrahle function such that 

j^Xdx = 0. Then X = 0 almost everywhere. 

Proof.— L&i & = E[X ^ l/fr]. Then fjhdx^ m(Et)/k, so 
that m(Ei) = 0. Since Ea ^ jE[X > 0] = ^ Ek, it follows that 
m(Eo) == 0. 

Let denote the class of all functions which are limits of 
bounded nondecreasing sequences of step functions, and let 
denote the class of all functions that are limits of bounded 
nonincreasing sequences of functions chosen from Similarly 
let SOZ” denote the class of all functions that are limits of bounded 
nonincreasing sequences of step functions, and let 20?"^ denote 
the class of all functions that are limits of bounded nondecreasing 
sequences of functions chosen from 5DZ“. Here the term “limit” 
is used to mean convergence at each point of the interval 7, not 
merely convergence almost everyivhere. It is easy to verify 
that each of the four classes of functions just defined is closed 
with respect to the operations I, IV, and V of Chap. X, Sec. 3. 

Leiwcma 2. Suppose X is hounded and measurable^ and e > 0. 
Then there exist a function from the class and a function yr 
from SOZ" such that pr ^ \ ^ and 

j /i+da; — + 

Proof.— Let («„) be a bounded sequence of step functions con- 
verging to X almost everywhere. Then by Theorems 2 and 4 

of Chap. X, there exists a set C = ^ 4 and an integer j such 
that m(C) < e/4JCj [a,- — Xj < c/4m(7) on J — C, and 




Xdx < -r; 
4 


where X is a bound for |X| and la,]. Let 


^ + 4m{I) 

;u+ = lim, a«, 


+ 2K 
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where 4>ij^ is the characteristic function of the interval i*. 



aidx + ^ + 2KmiC) 
}<dx + €. 


Then 


The function n is obtained by taking the negative of the func- 
tion from the class 50?“^ correspwjnding to (—X). 

Lemma 3. Let X he hounded and measurahle. Then there exist 
a function from the class 501“^ arid a function from 
sicch that ijr^ ^ X g and 


L 


dx == 



J. 


dx. 


Conversely, if there exist functions yr^from and y'^from 2)l' 

such that ^ X g and 




'dx 


then X is hounded and measurable. 

Proof — ^By Lemma 2 there exist sequences (yt) and (y~) such 
that jLt» ^ X ^ jut J and 

f [\dx^ [ Undx + l- 

Ji n Ji Jj n 

If JLI+ is an arbitrary function of the class such that X g jLt+, 
we may replace yt by the logical product jLt+ A jutJ. Hence we 
may suppose that the sequence (ju J) is nonincreasing. Similarly 
we may suppose that the sequence (ju") is nondecreasing. From 
this, the desired conclusion is obvious. For the converse, we 
note that by Lemma 1, y-^ = y^ almost everywhere, and hence 
yr^ = X almost everywhere. 

Now let us suppose that the interval 1 is the Cartesian product 
ly X Iz of an interval ly of a 2 (-space and an interval J* of a 
2 -space, Suppose also that a measure function my is defined for 
subintervals % of ly, and a measure function is defined for sub- 
intervals i» of Iz. For i — iyX iz we set m(i) — my{iy)mz(iz)^ 
Then it is clear that for a step function a(x) = a(y, z), L a dz 
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is a step function defined on 7y, and 

For convenience we shall say that an integrable function X(x) 
= X( 2 /j z) has the property P in case: 

Pi. HV} 2 ) is integrable on Iz for every y in ly] 

P 2 . My, dz is integrable on ly] 

P3. f^Xdx^ f^J^ Xdzdff. 

In case Pi holds only for almost all ?/ in Jy and P2 and P3 hold, we 
shall say that X has the property P*. 

Theorem 2. Fubini’s theorem. Eveiy integrable function has 
the property P*. 

As part of the proof we shall use the following proposition: 
Lemma 4. Let lim Xn = X everywhere on the interval I, where 

n 

the functions X« and X are integrable and the sequence (Xn) is uni- 
formly hounded. If each Xn has the property P, the limit X also has 
the property P. 

Proof. — By use of Theorem 4 of Chap. X, the preservation 
of the component properties Pi to P 3 can be verified in succession. 

Proof of Theorem 2. — We have already noticed that every step 
function a has the property P. Consequently all the functions 
in the classes and have the property P by Lemma 4. 
Now let X be bounded and measurable. Then by Lemma 3 
there exist functions from and from such that 

= L li. * ^y- 

Thus 

k k dzdy = 0, 

and hence by Lemma 1, 

(2:2) [^-^-( 2 /, z) - z)] dz = 0 

almost every^phere in the interval J„. Let S denote the set 
of points of ly at which (2:2) holds. Then by another applica- 
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tion of Lenuna 1 and use of (2:1) we find that for each y in the 
set S, 

2 ) = Hy, z) = z) 

almost everywhere on Thus \(y, z) is integrable on J, and 
X( 2 /, z) dz = pi^(y, z) dz 
for each ^ in Hence 

^ Hy, z) dz 

is integrable on 7y, and 

j^y^dx= l\dx, 

SO that X has the property P*. 

Since every integrable function is representable as the differ- 
ence of two nonnegative integrable functions, it is suflScient in 
completing the proof to suppose that X is nonnegative. Then 
== X A n is bounded and measurable and so has the property 
P*, and the sequence (X,») is nondecreasing. The sum of the 
exceptional sets where 

'Pniy) = X«(y, z) dz 

may fail to have a meaning is a set .B of measure zero in the 
interval ly, and so may be neglected. Now 

'PHy) dy = jjKdx 

and the right-hand side tends to X da: as n tends to infinity, 

by Theorem 12 of Chap. X. Thus, again by Theorem 12, 
= lim \pn(y) is integrable on ly and so is finite almost every- 

n 

where, and 

j^fdy = j^\dx. 

By a third application of Theorem 12 we have 

Hy) = Hy, z) dz 
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almost eveiywhere on ly, and so the function X has the property 
P*. 

Theorem 3. Let E he a measurable subset of the interval 7, 
and let denote the set of all points z such that {y, z) is in E, 
Then for almost all points y in ly, the set is measurable in Iz, and 

(2:3) m{E) = dy. 

This follows as a corollary of Theorem 2 by taking X as the 
characteristic fimction of the set E, 

It is interesting to note that the existence of the integral on 
the right in (2:3) does not imply the measurability of the set E, 
In fact, Sierpinski has given an example of a nomneasurable set 
in the plane which intersects an arbitrary straight line in at 
most two points.^^^ However, the following partial converse of 
Theorem 2 is valid. 

Theorem 4. If 'Kiy, z) is measurable on 7, and integrable on 
Iz for almost all y in h, and if |X(2/, z)] dz is integrable on ly, 
then X is integrable on L 

The proof is similar to the last paragraph of the proof of 
Theorem 2. 

fS. Integration by Parts 

Theorem 5. Let fix) be absolutely continuous and \ix) be inte~ 
grable on [a, b]. Let gix) “ gia) = 'h dx. Then fix)\ix) dx 

= /(%(6) - fia)g{a.) - g(x)f'(x) dx. 

Proof, — The product is absolutely continuous, by 

Theorem 25 of Chap. X, and (fg)' = fg' + fg wherever both 
derivatives f and g' exist and are finite. Moreover, the product 
fg\ which equals /X almost everywhere by Theorem 29 of Chap. 
X, is integrable by Theorem 8 of Chap. X, since f is continuous, 
and so fg is also integrable. Then the conclusion follows at 
once from Theorem 28 of Chap. X. 

The preceding theorem could also be obtained by applying 
Fubini’s theorem to the integral 

hf'(y)Hx}dxdy, 

1 ‘'SuT un probl^me concernant les ensembles measurables superficielle- 
ment,” Fundamerda MatheTnaticaei Vol. I (1920), pp. 112-115. 
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where D is the triangle E[a ^ t/ ^ x ^ bl It must first be 
proved that the product /'(^)X(i) is integrable over D. 

f4. Change of Variables. — ^At first we consider functions of 
one variable. Theorem 6 is a special case which is frequently 
useful. It is also a steppingstone to the more general Theorem 7. 

Theorem 6. Lei \(x) be bounded and measurable ona S ^ ^ b, 
and let the junction be absolutely continuous on c ^ t ^ 
and hojoe all its values on the interval [a, b]. Then the function 
integrable on [c, d], and 

= Ifummodt. 

Proof.— Let M = Lu.b. l\(a:)|, F(x) = j^\dx, G{t) = F{^{t)). 
Then the function G is absolutely continuous on [c, d]. For, if 
[ca, dh\ are nonoverlapping intervals in [c, d] such that ^ ll(di) 
“ S(ca)| < €, we have 

^ l(?(di) - (?(c*)l U(4) - ?(a)| ^ Mt, 

SO that the absolute continuity of G follows from that of 
Now let us consider the special case when X is continuous. 
Then the derivative F'(x) exists and equals \(x) everywhere, 
and hence G^(t) exists and equals X(S(^))5'(0 wherever f'(i) exists 
and is finite. From this we find 

/jr ~ 

= 

by Theorem 28 of Chap. X. 

Nejct let us suppose that the conclusion holds for each function 
X. of a sequence such that lX,(a:)l g K, and that X«(x) converges 
to \(x) everywhere on [a, 6]. Then lim X»(S(0) = ^(S(0) ^'(0 

n 

almost everywhere on [c, d], and the sequence is dominated by 
the integrable function K\i^{£)\. Thus by Theorems 11 and 7 of 
Chap. X, the conclusion holds also for the function X{a:)- 
Now it is easily seen that every step function is the limit of a 

^ It is interesting to note that this conclusion ccnild not be drawn if X were 
only assumed to be integrable. See Caratheodory [4], p. 554. 
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bounded sequence of continuous functions. Thus the conclusion 
holds when X(a:) is a step function, and hence also when X is a 
function of the class 9)2“+ or 9)2'+" of Sec. 2. By Lemmas 3 and 1, 
for an arbitrary bounded measurable function \{x) there exist 
functions ia 9)2“+ and At+” in 9)2+“ which are equal almost 
everywhere, such that 


(4:1) 

^4:2) 


ju-+(x) ^ \{x) S on [a, 

rwix- r 

Jnc) Jm Me) 


i], 


But by \rliat bas already been proved, 


( 4 : 3 ) 


with a similar equation for At+“, so that 

Jj dt = jj dt 

Hence Ai“+^' = /i+“J' almost everywhere on [c, d], by Lemma 16 
of Chap, X. By (4:1) XJ' lies between /i”+f' and at every 
point on [c, d] where exists and is finite, so that XJ'=M“+g' 
almost everywhere on [c, d]. This with (4:2) and (4:3) gives the 
desired formula. 

CoROLLAKY. If the function x = ^(t) is absolutely continuous 
on the interval c ^ i ^ d, and transforms a set T of that interval 
into a set X of measure zero in the interval a ^ x ^ b, then the 
derivative ^'(t) = 0 almost everywhere on T, 

Proof . — Let 4>{x) be the characteristic function of the set X. 
Then 


0 = 4>dx = 

Hence, by Lemma 16 of Chap. X, = 0 almost everywhere 
on c ^ i ^ d. But = 1 for i ia T, and hence = 0 almost 
everywhere on T. 

Theorem 7. Let \{x) he integrable on a ^ x ^ bj and let f (i) 
be absolutely continuous on c ^ t ^ d, and have all its values on 
the interval [a, 6]. Let X„ denote the function (X A n) V (~n). 
Then 

dx = ]im X„(J(«))r(i) dt; 
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2. Wheneoer X(|(i))|'(f) is integrable, 

3. X(^(^))f'(^) is always integrable when ^{t) is monotonic. 
Proof , — ^By Theorem 6, 

rf(d) rd 

Me) ^ 

and by Theorems 11 and 7 of Chap. X, 

This proves the first conclusion. Next ve have !X„?'l g jX$'l 
wherever is defined; hence, if X|' is integrable on [c, d], we have 

lim r X„|' dt = r X|' dt. 

n Je Jc 

To prove the third conclusion, we may suppose that is non- 
decreasing and, since every integrable function is the dMerenee 
of two nonnegative integrable functions, that X(a;) ^ 0. Then 
the sequence (X„?') is nondecreasing, and hence XJ' is int^rable 
by Theorem 12 of Chap. X. 

We note that if F(x) == X dx, then F{^{t)) is absolutely con- 
tinuous whenever X(|(^))|'(0 is integrable. Hence X(f(i))J'(^) 
is not integrable in the following example (MeShane [2], pa^e 
214); 

\(x) = |(i) = t^ cos* 

^(f(0) = cos (t/0* 

The transformation of multiple integrals is a diflScult subject, 
and we shall not attempt to include the very general results 
obtained by W. H. Young and by Rad6 and Eeichelderfer.^*^ 

^ The converse also holds. See Caratheodary [4] pp. 562, 563. 

2 See Rad6 and Reichelderfer, “A Theory of Absolutely Continuous 
Transformations in the Plane,” Transactions of the American Mathematical 
Sodetyj Yol. 49 (1941), pp. 258-307; also Helsel and Rad6, “The Transforma- 
tion of Double Integrals,” Transactions of the American Mathemaiiced 
Society, Vol, 54 (1943), pp. 83-102; and references in th<^ memoirs. 



224 


THE LEBESGUE INTEGRAL 


[Chap. XI 


However, the results developed below are sufficient for many 
purposes in analysis. 

Consider a transformation 

(4:4) T: x = f(u) 

of a set Q into a set B = T{Q). For definiteness we assume that 
Q and R are bounded open sets in ^-dimensional space and that T 
establishes a one-one bicontinuous correspondence between Q and 
R. Upon occasion the variables may be dmded notationally 
into sets, and attention restricted to special transformations of 
the form 

(4-5) T- ^ ■ ,v,) i = 1, • • • , p; 

^ ^ 'yi = Vj j = 1, ,a;p + <x = k. 

We shall also wish to consider a real-valued nonnegative firnc- 
tion J{u) {or J{UyV)) which is integrable on Q. 

Lemma 5. Suppose that for every interval i C -K? 

(4:6) m(i) = J du, 

and that Z is a subset of R of measure zero. Then / = 0 almost 
everywhere on 

Proof. — It is easily seen that T“^{i) is measurable. Let 
(Cn) be a nonincreasing sequence of open sets, with lim m{Cn) = 0, 

n 

Z C Cn C R, and let Qa = lim T~^(Cn). Then since each Cn 
is a sum of intervals, 

L Jdu^Um Jdu^hm m(Cn) = 0. 

Hence J == 0 almost ever 3 nvhere on Qo which contains T“^{Z), 
Lemma 6. Suppose that (4:6) holds for every interval i <Z R,' 
and that X(a;) is integrable on R, Then X[/(t^)]/(w) is integrable 
on Q, and 

(4:7) j^\dz = j^yJdu. 

Proof. — Suppose first that X is bounded. Let A be a finite 
sum of intervals contained in i2, and let (an) be a bounded 
sequence of step functions converging to X almost everywhere in 
A, Then by Lemma 5, lim an[f(u)]J (u) = h[f(u)]J(u) almost 
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everywhere on T-^{A). Also \a^J\ g MJ, where M is a bound 
for la„(a:)|. Immediately from (4:6) we have 

l^andx = du. 

Hence 

The open set R = lim An, where (An) is a nondecreasing sequence 
of finite sums of intervals. If X is unbounded, we may assume 
X ^ 0, and set Xn = X where X g n, X* = where X > n. Then 

f^\dx = ]jm f^^Kdx = ^ du= f^\J du. 

Lemma 7. Suppose that the transformation T is in the form 
(4:5), and that for each interval ix in the x-subspace and each y 
for which (i*, y) C R, have 

= f^Jiu,y)du, 

where {S^, v) = T~-\ixj y)- and m* is o-dimmsionat measure. 
Then for every interval i C R, 

m(t) = j^,^^^J{u,v)dudti}. 

Proof. — If i is the Cartesian product of ix and 4? is the 

set of aU iUj v) for which v is in iy and is in S^. Then by Fubini’s 
theorem, 

X-'ico ^ ji, !s.^ 

= f. mxiQ dy = m(t). 

Lemma 8. Suppose that T is defined by furwiions of doss C', 
that J is the Jacobian of the tramformation, and that J > 0 on Q. 
Then for every interval i C Ri 

(4:6) mil) = f^^^^Jdu. 

Proof. — The proof proceeds by induction on the number k 
of dimensions. The conclusion obviously holds for A = 1. 
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Suppose that it holds for k and that the transformation T is 
represented in the form 

X =f(u, Vi, • ■ ' , Vk), Vi = gjiu, Vi, ■ ■ • ,vk) 

j 1) * * • j fc. 

If i is an interval contained in fi, it is covered by a finite number 
of subintervals such that, on the inverse image of each, some 
partial derivative of / is not zero. Thus it is sufficient to verify 
(4:6) on subinter\’^als i on the inverse image of which some one 
partial derivative of / is not zero. Hence we shall suppose 
/tt > 0 on (In case/u < 0, we may reverse the positive 

direction on the t^-axis and on one i^f^xis.) Consider the 
auxiliary transformation 


Tiiw =fiu, v), Zj = v^. 

Then Ti is of class C and Ji =/« > 0 on a neighborhood Qq of 
r~i(io). Hence Ti^ is single-valued and of class C' on Ti(Qq), 
and so the second auxiliary transformation 

Tg = TT^^i X Wy Vj = hj(w, z), 

is of class C' and establishes a one-one correspondence between 
TiiQo) and a neighborhood So of the interval io. Its Jacobian 
J 2 = det (dhj/dzi) is positive and continuous, and J = J 2 J 1 . 
Then by the induction hypothesis, if (a;, iy) is in So, 

‘niy{iy) = J 2{Xj z) dz, 

where (to, = Ti" ^(x, iy), and so by Leipma 7, if t C ^o, 

Jiiw, z) dzdw. 

By Lemmas 7 and 6, applied to the transformation Ti, we have 

= k-Hi) ^ = It-KO k^i) ^ 

By combining Lemmas 8 and 6 we obtain the following result: 
Theoeem; 8. Suppose the transformation T establishes a one- 
one bicontinuous correspondence between the bounded open sets Q 
and S, that T is defined by functions of class C', and that the 
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Jacobian J of T is positive on Q. Then for every function X iwie- 
grable on Rj 

It is clear that in special cases we may be able to apply Lemmas 
7 and 6 when the transformation is not of class C'. As will be 
indicated in Sec. 5, the result extends at once to unbounded 
domains. The Jacobian J may be permitted to vanish at certain 
exceptional points, and the restriction that the transformation 
be one-to-one may also be lightened slightly. These possibilities 
are sufficiently indicated by the familiar example of transforma- 
tion to polar coordinates: 

z = u cos V, 0 ^ ^ 1, 

y = u sin V, —tt ^ t’ ^ it. 

In this case the boundary of the rectangle Q in the wy-plane 
transforms into a closed set of measure zero and, when these 
sets are discarded, the hypotheses of the theorem are satisfied 
on the remainder. 

*6. Integrals over Unbounded Domains. — ^It was remarked in 
Chap. X that the Cauchy improper integral of elementary 
calculus is not included as a special case of the Lebesgue integral, 
since the absolute value of an integrable function is also inte- 
grable. We shall make the same restriction in considering 
integrals over imbounded sets. 

Let X denote the interval (—oo, <»), and let Iq = I'-q, §]. 
In the case of space of more than one dimension, corresponding 
inequalities would be assumed for each coordinate, witti the 
same value of q. A fimction ju is said to be measurable on X in 
case p is measurable on each interval Iq, A function X is said 
to be integrable on X in case X is integrable on each Iq and the 

integrals ^ jx] dx are bounded. Then we define 



since the limit surely exists and is finite. The definiticm of 
measurable sets is extended to unbounded sets in the same way. 
The measure of an unbounded set may be finite or infi nite. 
When a family of functions X,*(a;) is given, we shall say that the 
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integrals (x»| dz converge uniformly when 
lim jT^ \\n\ dx ^ |Xn| dx 

uniformly. The definitions of functions of bounded variation 
and of absolutely continuous functions extend without change 
to the case of functions f{x) defined on unbounded domains. 

The following theorems of the preceding sections are stiQ 
valid when the domain of integration is the whole space X in 
place of a finite interval I: Theorems 8 to 13, 15, 18 to 20, 
22 to 24, and 30, and the Corollary of Theorem 17, in Chap. X; 
Theorems 2, 4, and 8 in Chap. XII. In Theorem 11 of Chap. X 

we obtain the additional conclusion that the integrals |Xn| dx 
converge uniformly. In Chap. X, Theorem 7 is still valid with 
the additional hypothesis that the integrals dx converge 

uniformly; Theorem 25 is still valid with the additional hypothe- 
sis, in the case of a product, that the factors are hounded; and 
Theorems 28 and 29 are still valid with the additional restriction 
that the function f(x) is of hounded variation. In Chap. XI, 
Theorem 1 is stUl valid with an additional hypothesis correspond- 
ing to that just mentioned for Theorem 7; Theorem 3 is valid 
except that the formula (2:3) may fail to have a meaning; 
Theorem 5 is still valid under the additional assumption that 
/(x) is of bounded variation; and the conclusions (2) and (3) 
of Theorem 7 are still valid when \{x) is integrahle on (— oo , oo) 
and either (a) ^(t) is absolutely continuous on every finite interval^ 
or (6) is absolutely continuous on every interval [c -f- €, d — e] 
and J (o) = — 00 , ^(d) =00. In Chap. X, Theorems 16 and 17 
are still valid for subsets of a fixed set E of finite measure, which 
may be unbounded. The left-hand inequality in Theorem 16 
holds without this restriction, as follows from Theorem 12. 
Theorem 26 does not extend, since the function f{x) = a; is 
absolutely continuous but is not of bounded variation on the 
whole a:-axis. However, a function f{x) is absolutely continuous 
if it is of bounded variation and is absolutely continuous on 
each /g. 

The proofs of these extensions will be indicated for Theorems 7, 
9, and 17, For Theorem 7, we have 
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lim L 1^1 ^ jx uniformly with r^pect to n, 

Ihu |Xn| dx = jjLtl dx for each q. 

Hence by Theorem 2 of Chap. YII, 

lim ^ 1X„1 da: = lim l#il dx = |ju| dx. 

The hypotheses required by Theorem 2 still apply when the 
absolute value signs are dropped, so lim L X« da: = f fi dx. 

Also lim ^ jXn — m 1 da; = 0, and since \lg (X« - m) da:| g 

— lA dx, the convergence is uniform for measurable sets E. 
For Theorem 9, let (anq) be a double sequence of step fxmctions 
such that hm Ong = X almost everywhere on Iq, a^q = 0 outside 

n 

Iq, and lim / \anq — X] da; = 0. From this double sequence 

we may select a simple sequence (aq) such that = 0 outside 
Iq, \dLq — X] da; < l/2«, and \aq — X] < l/2« on Iq — Cq, 
where m(Cq) < l/2«. Then it is easily verified that lim 5^ = X 
almost everywhere and lim \aq — X| da; = 0. 

For Theorem 17, since 7n(E) < oo, there is an interval Iq 
such that m{E — J^) < 6/2. There is a set Ci in S containing 
E “ Jg, with m(Ci) < 6/2, since this is so for the part oiE — Iq 
contained in each Ip. There is also a set Cs in S and a set A in 2 
such that m{C^ < €/2, and A — Cj C C. A + C%. Then 
we may take C = Ci + Cq. 

tThe extension of the notion of measure to unbounded sets 
makes it possible to regard the integral of a nonnegative inte- 
grable function of k variables as the (fc + l)-dimensional measure 
of the set of ordinates. 

fTHEOEEM: 9. Swppose that ^{x) is a nonnegative rneaswrabie 
function defined on the space X. Let E(jjl) denote ike set of aJl 
points {x, y) with 0 ^ y < p{x). Then EQi) is measurable and, 

if pis integrable, m(E{p)) = j^ndx. 

Proof . — ^Let (? be a bound^ measurable set in X, and let 4>e 
be its characteristic function. Then there is a sequmce of step 
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functions an{x), each of -n-hich takes only the values zero and one, 
such that 


lim a„{x) = 4>o{x) almost everywhere. 

n 

Theu 

lim <j>E(.aj = <l>E(ij>ff) almost eveiywhere. 

n 

Also m(E(an)) = !cin(x) dx, and hence E{4>g) is measurable and 
m(E{(t>G)) = = 7n(G), From this we see that the con- 

clusions of the theorem hold when /x is a function that takes a 
positive constant value on each of a finite number of bounded 
measurable sets and is zero elsewhere. Since every fx satisfying 
the hypothesis is the limit of a nondecreasing sequence of such 
fxmctions, the desired result follows. 

*t6. Invariance of Lebesgue Integrals and Lebesgue Measure 
of Sets under Motion. — It is easily seen that in the case of the 
Lebesgue measure, the measurability of a set and its measure are 
invariant under a translation of axes. Every rotation of axes 
can be obtained from a succession of rotations in each of which 
all axes but two remain fixed. Let i be an open interval in the 
coordinate system X" obtained from the coordinate system X' 
by rotating only two axes. Then i is a sum of intervals in X', 
by Lemma 5 of Chap. X. Since every interval in X" is a product 
of a sequence of open intervals in X", it follows readily that 
every set which is Borel-measurable in X" is Borel-measurable 
in X', and conversely. Moreover, the measure in the system X' 
of an interval i in X" can be calculated by means of Theorem 3 
and an evaluation of three elementary integrals and is thus found 
to equal the product of the edges of i. Hence every open set 
has the same measure in the two systems, and so has every closed 
set. Thus by the Corollary of Theorem 17 of Chap. X, every set 
that is measurable in one system is measurable in the other and 
has the same measure. By starting from functions that are 
step functions in one system it is easily seen that a function that 
is mtegrable in one system is also mtegrable in the other and 
has the same integral. This result extends at once to integrals 
over unbounded sets. 

7. Mean Value Theorems. — ^The first theorem is a generaliza- 
tion of Theorem 18 at the end of Chap. VI. 



Sec. 7] 


IKVABIANCE UXDEB MOTIOX 


231 


Theorem 10. First Theorem of the Mean. Let \(x) be 
integrable, and \{x) ^ 0 {or \{x) ^ 0 ) almost everywhere on the 
measurable set E, and let ii{x) be measurable and essentially hounded 
on E. Suppose 

(7 :1) L g ii{x) g U almost everywhere on E, 

Then 

(i) = M j^\dx, 

where L ^ M ^ U; 

(ii) In case E is a one-dimensional interval (a, b) {where a 
or b or both may be infinite) and ii{x) is equal to the derivative of a 
continuous function at every point of (a, &), thenM = ix{xq), where 
a < Xq <b. 

Proof, — ^Part (i) follows immediately from Theorem 8 of 
Chap. X. To obtain part (ii), we note first that, if X = 0 almost 
everywhere on {a, b), then M may be chosen arbitrarily and so 
may the point xo- Since the sum of a sequence of sets of measure 
zero is also of measure zero, it is easily seen that the least upper 
bound of the numbers L effective iu (7:1) is also effective, and 
likewise for the greatest lower bound of the numbers U. For the 
remainder of the proof we suppose that L is the greatest possible 
and U the least possible. If \{x) > 0 on a subset Ei of (a, b) 
with m{Ei) > 0 and if ti{x) > L on a subset E^ of Si with m{E^) 
> 0 , then ikf > jL by Lemma 1 in Sec. 2. Likewise, if fi{x) < U 
on a subset S 3 of Si with m{Ez) > 0 , then M < U, Thus, if 
ilf = i, we have /i(x) = ilf at almost every point of Si and, if 
M = U, we have y{x) = ilf at almost every point of Si, and Ei 
is a subset of the open interval (a, 6 ). But if S < M < Z7, there 
is a point Xo with a < Xq <b where fi{xo) = M, by Theorem 5 of 
Chap. V. 

*tTHEOREM 11. Second Theorem of the Mean. Let \(x) be 
integrable and p{x) be bounded and nondecreasing on the interval 
{a, b) where a or b or both may be infinite. Let L ^ p{a + 0), 
U ^ p{b 0 ). Then there is a poini xo wiQi a ^ Xq ^ b, sudi 
that 

\iidx -L X dx + 17 X dx. 

Proof . — We shall suppose that the interval (a, b) is bounded, 
since the conclusion extends at once to the unbounded case by a 
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simple argument. In case the conclusion is valid for a particular 
set Ly and U, it is also true for the set ju + c, L + c, ?7 + c, 
where c is any constant. Hence it is sufficient to consider the 
case when V = 0. We first take up the case when the graph 
of the function il{x) is a polygon, with ju(a) = L, /i(6) = [7 = 0. 

Then ii{x) is absolutely continuous. If we set g{x) X dx, 
we may apply the formula for integration by parts (Theorem 5) 
to obtain 



By the First Theorem of the Mean, the right-hand side is equal to 
—g(xo) n' dx = g{x^ii{a) L j^\dx. 


In the general case when fi{x) is any bounded nondecreasing 
function, let the interval (a, b) be divided into n + 1 equal parts 
by points xi, :C 2 , . . . , Xn, and let the graph of tJLn{x) be the 
simple polygon with vertices (a, jD), {xi, • • • , (Xn, 

K^n))) (b, 0). Then lim finix) = n{x) almost everywhere, since 
it is easily verified that the only possible exceptional points are 
the discontinuities of /i{x)j which form a denumerable set. 
Since the sequence (fin) is uniformly bounded, we have 


lim r \fin dx = r 'Kfi dx, 

n 


by Theorems 11 and 7 of Chap. X. But, by the part of the 
theorem already proved, 

\fin dx = L X dx. 

Since ^ X da; is a continuous function of the upper limit we have 

fh fxo 

I 'Kfidx = L I \dx 

for each point of accumulation xq of the sequence (ajon). 

8. The Inequalities of Schwarz, Holder, and Minkowski. — We 
have used the S 3 rmbol 8 to denote the class of all integrable 
functions. The symbol 8p is frequently used to denote the class 
of all measurable functions X for which jXj^ is integrable, where 
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p is a positive number. These symbols are used with reference 
to a fixed measurable set E as the domain of integration. For 
convenience the symbol E is omitted in the formulas that 
follow. The proofs are made by means of the following ele- 
mentary inequality 

Lemma 9. If U and V are nonnegative^ and 0 < e < 1, then 
^ eU + (1 - €)F, 

and equality holds only for U = F. 

Proof.— Let M =. ^ d + e - h Then /(I) = f (1) = 0, 

fit) > 0 for 0 < i < 1, fit) < 0 for i > 1, and so ft) < 0 for 
all i ^ 0 except t = 1. Novr the lemma obviously holds when 
F = 0. If F 7 ^ 0, we may set t = U/V, and so we have 



Upon multiplying by F and transposing, we obtain the inequality 
that was to be proved. 

Theokem 12. Holder’s inequality. Suppose that p > 0, 
q > 0, and p + = pq. Let X he a function in and let pie 
in Sg. Then \p is in S, and 

Uhpdxl ^ ifm^dx)^'ff\p\^dx)^^. 

Proof . — In case either X or /i is zero almost everywhere, the 
conclusion is obvious. In all other cases we may set 


Then 


Xi(a;) = 


\(x) 


in(x) = 


li(x) 


(8:1) /NJ-da: = /Ijml'dx = 1. 


In the lemma, take e = 1/p, U = jXij'’, Y = Then 

1 — € = 1/q, and 


( 8 : 2 ) 


lXi#ti| ^ 


1^ + N!. 

P Q 


Now the product Xun is measurable, by Theorem 5 of Chap. X, 
and so is integrable, by Theorem 10 of the same chapter, and 

^ See F. Hiesz, “Su aleune disuguagliaiize,” Bdttelino delPUnione Mate- 
wxAivh Itolima, 1928, p. 77. 



234 


THE LEBESGUE INTEGRAL 


[Chap. XI 


from (8:2) and (8:1) it foUovrs that 


J \iiJLidx 


- p q 


The inequality of the theorem follows at once. 

We note that equality holds if and only if |Xl^ bears a constant 
ratio to l/ij« almost everywhere and the product \jjl has the same 
sign almost everyv’here on the set where it is not zero. 

The inequality of Schwarz is the special case of Holder's 
inequality for which p = g = 2. 

Theorem 13. Minkowski’s inequality. Let X and ii he func- 
tions in where p 1. Then X + -is m 8^, and 

(/|\ + dxy^ ^ (/|xj^ dx)^^ + (;|a»1^ dx^f. 

Proof . — The case p = 1 follows from Theorem 8 of Chap. X. 
In the remainder of the proof we may suppose p > 1, and 
X g 0, jLi ^ 0, smce |X + ju| ^ |X[ + By the theorem just 
referred to, the function X^ V is integrable, and since 


(X + py ^ 2^'(X V = 2p(\^ V p^), 


the function X + /i is in 8p. Thus (X + p)^^ is in 8g, where 
q = p/(p — 1), and so by Theorem 12, the functions X(X + p)^^ 
and p(\ + p)^'^ are in 8, and 

/(X + p)p dx = JX(X + /z)^i dx + J/x(X + dx 

g [(JX^' dxy^ + (Jm^ da:)i/^](J(X + p)^ dx^^^^^K 

Division by the factor outside the square bracket yields the 
desired result. 

Minkowski's inequality is also called the triangle inequality. 
When p = 1, a necessary and sufficient condition for equality 
to hold is that Xjn ^ 0 almost everywhere. When p > 1, the 
condition is that X bears a constant nonnegative ratio to p 
almost everywhere. 

CorolIaARy. If the n functions X/ are in 8p, and 


j\K 3 \^ dx < € (i == 1, * • • , n) 

then 

dx < n^€. 
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*9. Nagtimo’s Criterion for Unifomi Absolute Continuity.^^' — 
The following necessary and sufi&cient condition is useful in 
applications: 

Theobbm 14. Let SKo he a class of functions fi, meamrabU on 
the set of finite measure. Then a necessary and sufficient 
condition that the functions y are integrahle on E* and the integrals 
jfidx are absolutely continuous uniformly and hounded uniformly 
on 90 ? 0 is that there exist a constant H and a function #(?) such that 

1. <|>(^) ^ 0 for 0 ^ t < CO ; 

2. co; 
js 00 t 

3. For every y in 9)lo, 4>(lM(a:)j) is integrahle on E* and 

dx < H. 

Proof . — To prove the sufficiency, let £? be a measurable subset 
of E*, and let e > 0. By (2), there is a value h such that ^(t) ^ 
2Htle for t ^ ti. Let Ei = <C ii], E^ = £?[i/tl ^ ii]. On 
E 2 , l/i(a;)l S €^{\ii(x)\)/2H, so that p, is integrahle and 

ImI dz ^ ^ + 1 


In proving the necessity of the condition we shall show that 
the function may be taken to be continuous and nondecreasing. 

Let K be chosen so that \fi\ dx < K. Let = E*[n ^ ImI 

faO 

<«+!]. Then ^ nm(E.^) < K, and hence for each int^er q, 

n=®0 

ao 

(9:1) 2 m{E.,) < j 

n=« 

By hypothesis there is a sequence of positive numbers Bj such 
that 

(9:2) jj4dx<^^ 

whenever 7 n{E) < Let (g,) be an incrHising sequaice of 
integers such that qjBj > K. Then by (9:1) and (9:2) 

1 Nagumo, '^Uber die gleichmassige Summierbarkeit und ihre Anwendung 
auf ein Variationsproblem,” Japanese Journal of MaihemaUcs, VoL VI 
(1929), p. 173. 
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[j-rl— 1 

2 


Now set 


#(0 = gi for 0 ^ i < qi, 


=( r [> 


t - Qi 


t for < Qi+i. 


~ V2/ L ^ 

Then with the help of (9:3) we find that 

qi-1 « 

j ^*( W )< b = ^ /.*«*+ 2 2 


i=l n*=ffj 


^ qim(,E*) + ^ p = qm(E*) + 1. 

i=i 

10. Modes of Convergence. — In this section we shall discuss 
the properties of and the relations between several modes of 
convergence. Let \l/(x, y) be a function which is real-valued for 
a; in a set jE and for in a set T, let & be a point of accumulation 
of r, and let g{x) be real-valued on E, We shall consider the 
limit 


(10:1) lim ^(a;, y) = g(x) 

V^b 

in the following modes: 

A. Uniformly on E; 

B. On E, or everywhere on E (ordinary convergence) ; 

C. Almost uniformly on E; 

D. Almost everywhere on E\ 

E. In measure on E] 

F. In the mean of order p on E- 

Uniform convergence has been discussed in Chap. VII, and 
ordinary convergence in Chaps. IV and VII. Modes C and D 
were introduced in Chap. X for the case when x ranges over the 
interval I and y ranges over the positive integers, but the defibni- 
tions are unchanged in form for the more general case of (10:1). 
Convergence in measure is a notion introduced by F. Riesz and 
is sometimes called approximate convergence. If we set 

Ey^ = E{\ilf{x, y) - g-Co:)! > e], 
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then lim ^ (x, y) = g{x) in measure on ^ in case 

V^h 

lim me{Eye) = 0 for every e > 0. 

Here we may agree that the points x where y) and g{x) 
are infinite of the same sign are not included in but that 
other points where either \p(xj y) or g(x) is infinite shall be so 
included. 

Finally, we say that lim ^(x, y) = g{x) in the mean of order 

y-b 

p on S in case 

lim 4 y) - = 0 . 

y^h 

Here it is understood that E is measurable and i^(x, y) — gix)\^ 
is integrable on E, We note that by Theorem 13 this vill be so 
whenever p ^ 1 and both y) and g(x) are in the space ?p 
on When the term “convergence in the mean^’ is used 

without qualification, it is sometimes understood to mean 
“convergence in the mean of order two’' or “convergence in 
the mean of order one.” 

We can properly use the term ccmvergence only when the limit 
g(x) is everywhere finite in modes A and B, and almost every- 
where finite in the remaining modes. But the use of the symbol 
(10:1) is subject to those restrictions only in modes A and C. 
We note, however, that even for modes E and F, we have g{x) 
finite almost everywhere when ^(x, y) is finite almost eversrwhere 
for every value of y. The definitions for modes C and E are 
sometimes phrased so as to remove such restrictions, as well as 
the need for the hypothesis that g{x) is finite almost everywhere 
in Theorems 17 to 19 below.^^^ But we are interested principally 
in the case when ^(x) is integrable. 

Theoeem: 15. If lim ^(x, y) = giQc) and Urn ^(x, y) = gi(x) 

y^b y’=b 

in mode C, D, E, or F, (hen gi{x) = g^{x) aXmoet everywhere. 

Proof . — ^For mode E, let E^ = E[\gi — ^ 2 ] > 2c], Eiy^ = 

“ > «]? ^ ^]* Then E^ C + E^^ for 

every y. Hence me(Ee) ^ and from this 

^ For a discussion of convergence in the mean of positive order less than 
one, see G, C. Evans, The Logarithmic Foterdial^ 1027, pp. 139-144, 

2 See MeShane [2], pp. 163, 164, 
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the desired conclusion is readily obtained. For mode F, we 
apply Theorem 13 in Sec. 8 and Lemma 1 in Sec. 2. 

Theorem; 16. If lim y) = g{x) in any one of the six 

y^h 

modes, then for every sequence {yf) in T with lim yn — 6, we have 

n= eo 

lim yn) = g(x) in the same mode. Conversely, if for every 

n=» w 

sequence (yn) in T with lim y^, = b, lim \p(x, yn) exists in mode 

»a= 06 n— » 

A, B, E, or F, then lim i/(x, y) exists in the same mode. The 

y^h 

converse does not hold for modes C and D. 

Proof , — If we set 

^{y) = l.u.b. \p{x, y) — s'(a:)| for x on E, 
then lim i/(x, y) = g{x) uniformly on E is equivalent to lim fi(y) 

y^b y=b 

= 0. Then it is clear that the first part of the theorem follows 
from Theorem 13 of Chap. IV. For the converse, we note 
first that from two sequences {yx^ and (^ 2 ^) we may form a 
new sequence by taking terms alternately from the given 
sequences. Then by the first part of the theorem, a limit func- 
tion for the sequence (j/n) wiU be one also for (yin) and (y 2 n). 
By Theorem 15, a limit function for (yin) wiU be one for (y 2 n). 
Hence we may apply Theorem 13 of Chap. IV. 

The following example shows that the converse is not true for 
modes C and D. Let E be the interval 0 g x S 1, and let T 
be the interval 0 S y ^ 1. Let 

#(*,»)-! for j = ^ + , 

= 0 for aU other points {x, y). 

Then lim sup -pix, y) = 1, lim inf ^{x, y) = 0, but for each y, 

y-0 y=0 

2/) == 0 almost everywhere. 

The following relations between the various modes of conver- 
gence are easily verified: A implies B and C; B implies D; C 
implies D and E. That C implies D was proved in Theorem 1 
of Chap. X for the case of sequences, and the same proof is 
valid in the general case. Mode D implies C under special 
conditions, as is shown in the next theorem, which is a generaliza- 
tion of Theorem 2 of Chap. X. 
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Theokem 17. Egoroff’s theorem. Suppose that each func- 
tion /Xn(a/) ts Measurable on the Measurable set E of finite Measure, 
that g(x) is finite alMost everywhere on E, and that lim fxjx) = g{x) 

n 

ahnost everywhere on E. Then lim At„(x) = g{x) alMosi uniformly 

n 

on E, 

Proof. ^Let E^e = E[\fin{x) — g(x)\ > e], where we shall include 
in Ene all the points where g(x) is infinite. Let 

oe 

= 2 E.., n -Sp. = 8,. 

p=l 

Then ?w(>Se) = 0, and hence lim M(Spi) = 0 by Theorem 16 of 

p= « 

Chap. X. If we set eu = 1/k, then for each fc there is an integer 
Pk such that < 1/2*’. We have m{E^ < l/2«-*, where 

OQ 

k = q 

and thus by the Corollary of Theorem 17 of Chap. X, there exists 
a set Cq in S, including Eq, with m(Cq) < 1/2^K Then, if x 
is not in C5, we have |/zn(x) — ^(x)] ^ l/kfoin S Pi, orlim 

n 

~ g{x) uniformly on jS — Cq. 

Theokem: 18. Suppose that E is a measurable set of finite 
measure, that ^(x, y) is measurable on E for each y in T, thai g(x) 
is finite almost everywhere, and that lim f(x, y) = g(x) almost 

y=b 

everywhere on E. Then lim ^(x, y) = g{x) in measure on E. 

Proof. — ^By Theorem 16 it is sufficient to prove the result 
for sequences, but for this case it follows from Theorem 17 and 
a previously noted relation. 

Theorem 19. Suppose that g(x) is finite almost everywhere and 
that lim ^{x, y) = ^(x) in measure on E. Then there ansts 

y^b 

a seqvmce (yk) of distinct points in the range T of y, such thcA 
lim yje = b, and lim ^(x, = ^(x) almost uniformly on E. 

k = 00 « 

Proof. — By Theorem 16, it is sufficient to conader the case 
of a sequence (ipnix)). Let E^ = E[\4/.{x) — p(x)l > e], where 
it is understood for convenience in the following that the points 
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where g{x) is infinite are included in Ene, and let e* = 1/h Since 
lim me(Ene) = 0 for every e > 0, for each k we may choose 

n 

Tik > rik^i such that me(Enj,€t) < 1/2*. By definition of exterior 
measure, there exists an open set Gjs D Enj^et such that m(Gk) 

ao 

< 1/2*. If we set Ep = Gt, then m{Ep) < 1/2^-^ and, on 

E — Epj - g{x)\ ^ l/k for ft ^ p, so that the sequence 

is the required one. 

It is easy to construct a sequence of functions converging 
in measure to zero, but such that the sequence converges in the 
ordinary sense at no value of x. For each positive integer ft, let 
the fundamental interval I be divided in any manner into 
ft measurable subsets Eki, . . • , ^kk of equal measure. Arrange 
the sets Ekj in any manner as a simple sequence Sn, and let xpn 
be the characteristic function of Then lim m(Sn) = 0, but 
lim sup = 1, lim inf ipn(x) — 0 for every x. 

Theoeem 20. If E is measurable, y) is measurable on E 
for each value of y, and lim \l/{x, y) = g{x) in any one of the modes 

yssh 

A to E, then g{x) is measurable on E. In the case of mode E, we 
assume also that g(x) is finite almost everywhere. 

Proof. — This follows readily from the preceding theorems and 
the Corollary of Theorem 4, Chap. X. 

fTHEOREM: 21. Suppose that the set E is measurable, and 
that the function ^(x, y) is in the class 2p on E for each y in T, where 
^ 1. Suppose that the integrals J\^{x, y)\^ dx are absolutely 
continuous uniformly with respect to y, and converge uniformly with 
respect to y in case E has infinite measure. Suppose finally that 

(10:1) lim ^{x, y) = g{x) 

in any one of the five modes A, B, C, D, or E. Then g{x) is in 
and (10:1) holds in mode F. 

Proof. — ^It is sufficient to prove the result for the case of 
sequences (^n(rc)), by Theorem 16. For the modes A, C, and E 
it follows from the defiboitions and the fact that the functions 
must be finite almost everywhere that the limit g(x) must 
be finite almost everywhere. Thus in any case there is a subse- 
quence, for which we use the same notation such that 

lim = g(^x) in mode and lim in mode D. By 
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Theorem 20, g{x) is measurable. Then by Theorem 7 of Chap. X, 
g{x) is in Sp, and by Theorem 13 of Sec. 8, the functions — g) 
are in Sp. From the inequality — g]^ g it 

follows that the integrals /|f„ — g f dx are absolutely continuous 
uniformly and converge uniformly. Hence 

(10:2) Im g\^ dx = 0 

by Theorem 7 of Chap. X. If a subsequence was chosen, it 
follows easily that (10:2) holds on the original sequence. 

*For the case of a general measure function, with convergence 
in mode B or D, it is necessary to add an assumption ensuring 
that g(x) is finite almost everyw'here. See the remark following 
Theorem 6 in Chap. X. 

When the functions and g in the preceding discussion depend 
also on a parameter <r, it is sometimes desirable to know that the 
integrals converge uniformly with respect to <r. For the case of 
convergence in mode D we have the following result; 

Theoeem 22. Suppose that E is measurable and that a) 
is in 2p on E for each y and a, where p ^ 1. Suppose that the 
integrals y, (t)\^ dx are absolutely continwous uniformly with 
respect to y and o-, and converge uniformly with respect to y and <r in 
case E has infinite measure. Su'frpose finally that lim ^(a:, y^ a) 

= g{x, cr) uniformly with respect to <r, except for x in a fixed subset 
Eq of E of measure zero. Then the integrals f\gix^ a)\^ dx are 
absolutely continuous uniformly with respect to tr and converge 
uniformly with respect to a, and 

lim L \Hx, y, <r) — gix, ff)\^dx = 0 

y=b 

uniformly with respect to o*. 

Proof . — Since 

g [/lsr(x, <r) - i^ix, y, i7)\^ dx] 

+ U\^ix,y,c)\-dxV'> 

by Theorem 13, the first part of the concluaon follows from 
Theorem 21. If the last part is false, there exist a positive 
number e and sequences (|/») and (ff«) such that lim y. = 6, and 
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I'f'ix, y„, 0 -„) - g{x, dx > e. If -n-e set <p„{x) = iPix, y^, 
<^n) — g{xj £r„), we have lim ypnix) = 0 except on Eq, and the 

n 

remaining h 5 rpothesis of Theorem 21 for the functions is 
verified with the help of the Corollary of Theorem 13, so that we 
are led to a contradiction. 

Theorem 23. If 

(10:1) lim y) = g{x) 

y^h 

in the mean of order p on E, then (10:1) holds also in measure on E. 
Proof. — If we let 

Ey. = E[\i^(x, y) - g{x)\ > e], 

then Eye is measurable and 

Je y) - gix)\^dx > ^m(Ey,). 

The conclusion follows at once from this inequality. 

The next theorem in combination with the preceding forms a 

partial converse of Theorem 21. Its proof is immediate. 

Theorem 24. If lim = g{x) in the mean of order p on 
00 

E, then the integrals J\\pn — g\^ dx are absolutely continuous uni- 
formly and converge uniformly with respect to n. When g{x) is in 
the integrals dx also have these properties. 

Theorem 25. Let 0 < s < g, and let (10:1) hold in the mean 
of order q on E, where E is a set of finite measure. Then (10:1) 
holds also in the mean of order s on E. 

Proof. — By Theorem 16, it is sufficient to consider the case of a 
sequence Let fin(x) = |^n(^) — g(^)|. Then lim fXn(x) 

n=> 00 

= 0 in measure on E, by Theorem 23. Also Mn = 1 + Mn? so 
that An is integrable, and 

^miEo) + 

for every measurable subset Eq of E. With the help of Theorem 
24 it follows that the integrals /mw dx are absolutely continuous 

uniformly with respect to n, and then Urn L An da; = 0 by 

ns 00 

Theorem 21 for p = 1. 
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The Cauchy condition for convergence in mode A was given 
in Theorem 1 of Chap. VII, and for mode B in Theorem 10 of 
Chap. IV. The corresponding condition for modes C, D, E, and 
F is stated in the foUo\\ing theorem: 

Theorem 26. Suppose that y) is finite almost everywhere 
on E for each y in T, Then a necessary and sufficient condition 
that there exists a function g{x), finite almost everywhere on Ey such 
that Urn yp{Xy y) = g{x) in mode C, D, E, or F, is that 

y = b 

(10:3) lim {^(x, yi) - yt)l =0 

yi^h 

yi=h 

in the corresponding mode. For mode F we suppose that p ^ 1 
and that i/ix, y) is in 2pfor each y in T, and then g{x) is necessarily 
also in 2p. 

Proof, — For mode C, the proof is based on Theorem 1 of 
Chap. VII, and the necessity of the condition is then obvious. 
Also if 

lim Mx, yi) - fix, t;*)l = 0 

yt=i 

uniformly on ^ — C., then the limit g{x) is determined and finite 
except on C«. We may suppose m(Cn) < 1/2^, and so g(x) is 

determined except on the set Z = nc'., and m(Z) =0. 

For mode D, the condition follows from Theorem 10 of Chap. 
IV. 

To prove the necessity of the condition for mode E, we note 
that 

E[\4/(x, yi) — ^(x, y*)l > 2e] C M.\Hx, Vi) — 9 (x)\ > e] 

+ E[\Hx, yt) - ff{x)l > <1, 

so that, if the exterior measure of each of the last two sets is 
less than p, the exterior measure of the first is less than 2p. In 
proving the sufficiency of the condition for mode E, we may first 
prove by familiar methods that 

lim \il/(x, yn) — ^(x, yi)| =0 

n= « 

fcas eo 

in mode E for every sequence (yn) with lim y* = b. Hence by 
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Theorem 16 we may restrict attention to the case of a sequence 

(^„(a;)). For each there is an integer rij such that the set 

^[|^» — yj/k\ > 1/2’] has exterior measure less than 1/2’’ whenever 

n ^ n,-, k ^ n,. We may also suppose tii > n,--!. For each j 

there is an, open set Oj 3 — ^«il > I/S’] such that 

00 

m(Gj) < 1/2’. Let C* = ^ G,-. Then for I > j ^ k, l^„,(a:) 

— ^ l/2^‘ except on C*, so that by the Cauchy condition 

for mode C, there exists a function g{x) such that Ihn ii/n,{x) 

J= ee 

= g{x) almost uniformly on E. Moreover, l^»,(a:) — ^(a:)l 
g 1/2’“* except on Cj, so that for n § 

\\j^„{x) - g \4>„{x) - + li'niix) - g-Ca;)! g ^ 

except on a set whose exterior measure is less than 

For mode F, the necessity of the condition follows readily 
from the Corollary of Theorem 13. To prove the suflBciency, we 
note that by Theorem 23, (10:3) holds in mode E, and hence 
by the part of the theorem already proved, there is a function 
glz) such that lim \p(x, y) — g{x) in measure. Then by Theorem 

y = & 

19 of the present chapter and Theorem 1 of Chap. X, there is a 
sequence {y^ with lim t/n = such that lim 2/n) = g{x) 

n= « n=» «o 

almost everywhere. Let 2^n)- Then for each value 

of fc, 

1™ = 15"“ ^*1^ almost everywhere. 

n= « 

We next proceed to show that for each value of k, the integrals 
fl'I'n, — dx are absolutely continuous uniformly and converge 
uniformly with respect to n. For every e > 0, there is an integer 
fco such that iin > ko, then 

(10:4) dx <e. 

Also there exists a number 5 > 0 such that iin ^ ko and m{Eo) 
< 5, then 


(10:5) 


U'n - dx < €, 
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since there are only a iSnite number of integrals in this set when 
k is fixed. By appl 3 dng the Corollary of Theorem 13 to (10:5) 
with n — ko and (10:4) with E replaced by Eq we find that, for 
n > ko and 7n{Eo) < 5, 

\^n “ dx < 2^6. 

The uniform convergence of the integrals is proved in a similar 
way. Then by Theorem 7 of Chap. X, 

lim f l^n “ = X ^ 

71 =s so •' 

and by Theorem 3 of Chap. YII, 

Ihn L\g — M’’ da: = 0. 

jb= 00 

Since by Theorem 13, 

[j^ I'l'ix, y) - g(x)\’’dxy’’ g [j^ \4^{x, y) - (f't(a:)!'da:j‘‘'' 

+ [^ - g{x)\*dxY^> 


we are led to the desired result. 

The next theorem outlines sufficient conditions that the limit 
operator in the various modes be distributive with respect to the 
operations I to V of Chap. X, Sec. 3. 

Theorem 27. Suppose that gi(x) and gt{x) are finite almost 
everywhere on E, and that 

Ihn ^i(aj, y) = giix), lim y) = gtix), 

yssh y—h 

on E in any one of ike six modes KtoE, Then 

I. lim (^1 + ^ 2 ) == 5^1 + g%y 

y^b 

II. lim aipi = agij for every finite comtard a, 

ytsb 

IV. lim (#i V 4'i) = V gt, 

y^h 

V. Inn (^l/l A ^ 2 ) = A g^, 

in the same mode, provided ikat gi and gt are everywhere finite in 
case of mode A, that gi and gt are nowhere infinite of opposite sign 
in case of mode B, and that we setO • °o = 0. We have also 
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III. lim 4fi4i2 = giQi, 

y = b 

in modes A E provided that gi and a,re hounded in case of 
mode A, that the form 0 • ^ does not occur in case of mode B, and 
that the set E has finite measure in case of modes C and E, and 
further that gi and g^ ore measurable in case of mode E. In case 
p + q — pq,p > and gi are in 8p, ^2 and g^ are in Sg, 

liTTi in the mean of order p and lim ^2 = ^2 in the mean of 

order q, then III holds in the mean of order L 
Proof. — We shall indicate the proof for III in mode E. The 
proofs in the other cases are readily constructed. Let p > 0. 
Then there is an integer n such that 

m{E[\gi\ > n]) < p, m{E[\g 2 \ > n]) < p, 

by Theorem 16 of Chap. X. Then if 0 < € < 1, there is a neigh- 
borhood NQ)] d) such that for y in iV(&; S), 

me(E[\M^, y) - gi{x)\ > e]) < p, 

with a corresponding relation for ^2 and ^2. From these rela- 
tions it follows that for y m. NQ>] h), 

y) y) - gi(x)g 2 (x)\ ^ {2n 4- 1)€ 

except on a set whose exterior measure is less than 5p. 

In Chap. VII, Sec. 4, the space S, composed of all continuous 
functions f[x) defined on a fixed bounded closed set E, was dis- 
cussed and was seen to be a complete normed linear space, with 
||/[| = l.u.b. \f{x) I on E. The results of the preceding paragraphs 
indicate that we may use each of the modes of convergence A to F 
to define points of accumulation in a space consisting of a suitable 
class of functions. For p ^ 1, we may set 

llxll = [;|X(a:)l-dx]vp 

for each X in Sp. We meet here with the difficulty that [[XH = 0 
does not imply X(x) = 0. However, if we agree that two func- 
tions are equivalent when they are equal almost everywhere, we 
find with the help of Theorems 13 and 26 that the space of all 
equivalence classes composed of functions X in is a complete 
normed linear space. It is convenient to denote this space by 
the same symbol 8p, and to denote the equivalence class to 
which a function X belongs by the same symbol X. 
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The modes of convergence B, C, D, and E do not correspond 
to normed linear spaces. We maj' define a norm ; , such that 

lim = i^inmeasureif andonly iflim — p " = 0,asfollows: 

” n 

ll^ll = g-i-b- of ail € such that > e]) < e. 

But this norm does not have the property that = \a\ • [^'1. 
Since it does have the property that + ^ 2 : ^ 
we see that the space of equivalence classes of functions is a 
metric space with the distance between and ^2 defined to be 
11^1 — 

*We conclude this section with the following theorem, w^hich 
may be regarded as showing that the operation of translation in 
the space 2p is continuous: 

*tTHEOEEM 28. If \{x) is in % where p ^ 1, then 

lim f |X( 2 : + 0 - X(a:)|p dx = 0. 

t=o 

Proof. — By Theorem 13 it is sufficient to consider the case 
when X ^ 0. By Theorem 9 of Chap. X, there is a sequence 
(an) of step functions such that lim L\(Xn- X^l dx = 0. It is 

clear that we may require that ^ 0, and then we may set 
j3n = oin- Since \Pn — Xj^ g \Pl — X^], Tve have 

lim li3. - Xl'’ dx = 0. 

For fixed n, lim |p«(a; + t)— j3«(a:)l = 0 almost everyivhere and, 

since i3„ is bounded and equal to zero outside a sufficiently 
large interval, we have 

lim f ji3n(a: + 0 - Pn{x)\^ dx = 0. 

Jx 

By another application of Theorem 13 we are led to the desired 
result. 

We note that Theorem 28 holds true for functions of several 
variables, but not for a general measure function. 

* 11 . Orthononnal Systems in the Space ? 2 .— Let be a fixed 

measurable set of positive measure, and let (X») be a sequence of 
^ See Fr^chet, Les eapaces abstraits, pp. 91, 92, where a ^htiy different 
distance is defined. 
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functions in 82 on the set E, The linear extension (X«)l of (X^) 
consists of all finite linear combinations of functions chosen from 
the sequence. The linear closed extension Q^lc consists 
of all functions that are limits in the mean of order two of 
sequences chosen from As usual we do not distinguish 

between functions that are equal almost everywhere on E. 

The system (X^) is said to be orthonormal on jE in case 
/X«X« dx = bmn, where 5n« = 1, = 0 for m n. All integrals 

are understood to be taken over the set E. A familiar example 
of an orthonormal system is the set of trigonometric functions, 

(11 ll) Xo(3/) J X2ft(x) y— 3 X2ft— 1(^) y— 3 

V 27r V ^ V ^ 

when the set E is an interval of length 2 t. 

Theorem 29. For every sequence (^n) in S 2 , there is an ortho-- 
normal sequence (Xn) {which may be finite) which has the same linear 
extension. 

Proof . — ^Let H^H = dxf^, and let juo denote the first 3}/^ with 
[|^„]| 9^ 0. Let Xo = fJLo/WmW- If ^0, * • * , Xff have been 
determined, let \l/k be the next unused function of the sequence 
(^„). Let 


Ilk ^ j 

3=0 

Then J/ijbXj da; = 0 for j = 0, • • • , g. If |(m*|| 9 ^ 0, set X^r+i 
= }ik/\\fik\l If|lMft|| = 0, discard and try ^*+ 1 . 

A sequence (X^) is said to be complete in S2 in case the only 
functions ^ in 82 for which 

(11:2) dx = 0 (n = 0, 1, 2, • • •), 

are equal to zero almost everywhere. A sequence (X^) is said to 
be closed in 82 in case the linear closed extension of (Xf) is the 
whole of 82. 

Theorem 30. The sequence (11 :1) is complete in 82. 

Proof. — We shall show that (11:1) is complete in the class 
8 on the interval I = [0, 27r]. This is a larger class than 82, 
since the interval I is finite. If ^ is in 8 and satisfies (11 :2) with 

the functions (11:1), let /(a;) = if/dx. Then/(0) = /( 27 r) = 0 
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and, by integrating by parts in ( 11 : 2 ), \re find 

P'Kjdx = 0 (n = l,2, •••). 

If ^ f dx = 2 tc, then (f — c) dx = 0. Thus ( 11 : 2 ) holds 

with ^ replaced by ^ = / — c. If g(x) ^ 0, suppose for definite- 
ness that g{xo) = 2€ > 0, where 0 < Xo < 2 t. Since g is con- 
tinuous, there is an interval /o = [xo — S, a:© + 5] C I such that 
gix) > € on Jo. Let 

t(z) = 1 + cos (a; — a?o) — cos 5. 

Then t{x) > 1 on the interior of Jo, but < 1 on the interior 
of J — Jo. Now by ( 11 : 2 ) with g in place of 

( 11 :3) 0 = gt^ dx = gt^ dx + gt”’ dx. 

But the first integral on the right in (11:3) approaches infinity, 
and the second integral approaches zero, which leads to a contra- 
diction. Hence g{x) ^ 0 , and so 4^{x) = 0 almost everywhere. 
Theorem 31. BessePs inequality. Let 

(11:4) a» = / i^-K dz (n = 0, 1, 2, • • •), 

where (X^) is an orthonormal system and ^ is an arbitrary function 
in 82 . Then 

to 

2^1^ lrdx = M\\ 

n=»0 

Proof. — ^We have 

(11:5) 0 g / (^ - 2 al 

71 = 0 n = 0 

Theobem 32. If (X„) is an orthemormal system, then for fixed ^ 
and g, the expression 

q 

/ (^ “ 4 a«X,)* dx 

» = 0 

is a minimum when the coefficients o* are given by (11:4) for 

n = 0,l,---,q. 
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Theorem 33. Let (Kn) he an ortho7iormal system and let the 
series ^ a® converge. Then there is a function xp in 82 such that 

lim ) OrXi = ^ 

* n =0 

in the mean of order 2 . 

Proof . — Since 


/ (2 = 2 

n—p n=p 

the desired result follows from the Cauchy condition for the 
convergence of the series ^ al and the Cauchy condition for 
convergence in the mean (Theorem 26). 

Theorem 34. If (Xn) is an orthonormal system and 

(11:6) lim y flnXn = P 

«=■ * n^o 

in the mean of order 2 , thm the coefficients a^ are given by ( 11 : 4 ) and 

eo 

(11:7) lal= 

n«0 

Proof . — From the Schwarz inequality (Theorem 12 ) we find 
that 

q 

(11:8) Im f <in\, -Adx = 0 

®“ “ n-O 

for every function rp' in S 2 . Then the first part of the theorem 
is obtained by taking The equation (11:7) follows at 

once from ( 11 : 6 ) and the right-hand equality in ( 11 : 5 ). 

Theoebm 35. The Riesz-Fischer theorem. If (X„) is an 
orthonormal system and the series ^ o® comerges, there is a function 

yp in ?s satisfying the equation ( 11 :4) . The function ^ is uniquely 
detenmned (apart from sets of measure zero) if and only if the 
system (K) is complete. 



Sec. 11] 


ORTHOXOSMAL SYSTEMS 


251 


Theoeem 36. Parseval’s theorem. If (X«) is a complete 
orthonormal system, ^ and are functions in So, <ind 

On — j dx, al = j dx, 

then 

eo 00 

^ = il’/'llS y anfln = / 'hP' dx. 

w=0 n=0 ^ 

Parsevars theorem follows at once from Theorems 31, 33 to 35, 
and equation (11:8). 

Theoeem 37. A necessary and sufficient condition that a 
sequence (X«) he closed in S 2 is that it he complete in S 2 . 

Proof , — ^By Theorem 29 we may suppose the system (X«) is 
orthonormal. Then the necessity of the condition follows from 
Theorems 32 and 34, and the sufficiency from Theorems 31, 33, 
and 35. 

It is obvious that a sequence (X«) is closed in ?2 in case it is 
known that its linear closed extension contains a set ever 3 rw'here 
dense in S 2 , as for example the set of all step functions or the set 
of all continuous functions. However, there exist orthonormal 
systems of continuous functions which are not complete in 
S 2 but are such that the only continuous function ^ satisfying 
(11:2) is identically zero. An example may be constructed as 
follows. Let (wn) be an orthonormal system of continuous 
functions which is complete in ? 2 . Let be a function in ?2 
which is not equivalent to a continuous function. Not all the 
coefficients 

c« = JifyTrndx 

are zero, and we suppose for convenience of notation that 
Co ^ 0, Then let Xn = CoVn^i — Cn+i^o, and suppose 

(11:9) HKdx = 0 (ri = 0, 1, 2, • • •)• 

From this it follows that the coefficients 

dx 

are proportional to the coefficients Cn of the function Then 
by Theorem 35, ^ is proportional to Conversely, (11 :9} holds 
when ^ is proportional to <t>. But then ^|/ cannot be continuous 
unless it vanishes identically. 
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*tl2. Additional Theorems on Differentiation. — The next 
theorem on interchange of order of limit and derivative bears 
little resemblance to Theorem 8 of Chap. VII. 

Theorem 38. Suppose that the junctions /„(x) and f(x) are of 
hounded variation on {a, b], and that lim t(fn — f) =0. Then 

na= to 

lim /' = f in measure on [a, &]. 

nsB CO 

Proof , — By Theorem 30 of Chap. X, Sec. 6, 
t(J.-f) ^ f'\f'^-f'\dx. 

Then the conclusion follows from Theorem 23 of Sec. 10. 
Corollary. Let the functions gk{x) he nondecreasing on [a, &], 

and let the series ^ ~ gkici)] converge. Then f(x) = 

^ — ^ifc(^)] converges uniformly on [a, b] and f{x) = ^ gl{x) 

almost everywhere on [a, b]. 

This follows with the help of Theorem 19 and the fact that 
gii^) ^ 0 almost everywhere. The corollary has an immediate 
extension to the case where the functions gk(x) are only of bounded 

variation, and the series ^ t(gk) converges. 

Let fix, y) be an integrable function of two variables, which 
we may suppose to be defined throughout the a;2/-plane, and let 

(12:1) F{x,y)^ j; j;S{k,v)dndl 

Then it may be shown that 

Y^ F{x^h,y + k) -Fix,y + k) -Fjx + h, y)+Fix, y) _ 

A=o hk ^ 

ifc=0 

almost everywhere, provided either (a) the function 1/| log+ |/1 
is integrable, where log+ |/1 = log [|/1 V 1]; or (&) the limit is 
taken over sequences (fc«) on which the ratios hn/kn and 
kn/hn are bounded. For the proof, see Saks [1], Chap. 4, espe- 
cially pages 106, 118, 132-133, 147-149. A related but inde- 
pendent result is the following: 

Theorem: 39. If fix, y) is integrable and Fix, y) is given by 
(12:1), then there exists the 'partial derivative 

y) = f{x, n) drj 


( 12 : 2 ) 
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except for x in a set G which has linear measure zero and is inde- 
pendent of y, and there exists the mixed partial derivative Fxu{Xj y) 

= f{x, y) almost everywhere. 

Proof , — By Theorem 29 of Chap. X, we see that the first part 
of the conclusion holds when y is restricted to be rational. For 
the remainder of this paragraph it is convenient to supper 
f(x, y) ^ 0. We may then show that the exceptional set G 
effective for rational y’s is effective for irrational y's as well. 
For, an irrational y lies between two rational values t/i and t /2 
having the same sign as y and then, since f{x^ y) preserves its 
sign, each partial derivate DJF{x, y) lies between 

Fxix, yi) = Jq'Kx, v) dn and F*(x, y^) = f{x, n) dv 

for X not in G, But Jj fix j i?) d?? is a continuous function of y 

for X not in G, and hence there exists Fx{x, y) = i: f{Xj v) di). 
By another application of Theorem 29 of Chap. X, we see that 
there exists Fxy{x, y) = f(x, y) unless a: is in G, or y is in a set if* 
whose linear measure is zero. Then by Theorem 3 it follows 
that the exceptional set, where Fgy does not exist or is not equal 
to /, has planar measure zero if it is measurable. Thus to 
complete the proof it is sufficient to show that each of the four . 
Dini derivates DyFx is measurable, where the set G is neglected. 
The expression 

fsiJrh fy+h 

M(x, y;h, k) ^ I J /(f, v) dn d^ 


is continuous in {Xj y) for each h and fc, and so is measurable. 
Except for x in G, 


Q(x, y; h) 



= liT-n 


M{x, y, h, k), 
hk ’ 


and so Q(x, y, h) is measurable for h 0. For each x not in G, 
Q is continuous in h, and so 


fi(x,y;S) s l.u.b. Q^x, y, h) 

0<A<5 

= l.u.b. QiXj y; r) for rational r. 

0<r<5 



254 


THE LEBESGUE INTEGRAL 


[Chap. XI 


Then by Lemma 13 and Theorem 21 of Chap. X, Sec. 4, y;8) 

is measurable, and finally lim y; 5), which is the upper 

5 = 0 

righthand derivate of Fx(x, y), is also measurable. The meas- 
urability of the other three derivates follows with the help of 
Lemma 15 of Chap. X, Sec. 5. 

*tl3- Integral Means. — In Sec. 11 we considered briefly the 
approximation of functions in S 2 by linear combinations of 
functions from an orthonormal system. In Chap. VII, Sec. 4, 
we considered the approximation of continuous functions by 
pol 3 Tiomials. In this section we shall develop a few- elementary 
properties of the approximation to functions in or in by 
integral means. At first we restrict attention to functions of one 
variable. 

Let X denote the a:-axis, let ^ be a measurable subset of X, 
and let \(x) be a measurable function which is integrable on 
every bounded subset of E. For convenience we define \(x) =0 
on the complement of E, Then we may define the integral mean 

1 TA 2 rx’hh 

(13:1) \h(x) = ^ \(x + s)ds = J ^ X(s) ds 

for all A > 0 and for all values of x. It has the following proper- 
ties: 

Ml. lim Xa = X almost everywhere, and in particular at 

h^O 

all the points w^here X is continuous. 

M2. \h is absolutely continuous on each finite interval, and 

(13:2) X;(a:) = - Mx - h) 

Ah 

almost everywhere, and in particular at the points x such 
that X is continuous at {x + h) and at (x — h). Hence, 
if X is continuous everywhere, X* is of class C\ 

M3. If X is in Sp (p ^ 1), so is X^. 

M4. On every finite interval the integrals J\hdx are abso- 
lutely continuous uniformly for 0 < A < 1. 

M5. If X is in Sp, the integrals JIXaI^ dx are absolutely con- 
tinuous uniformly and converge uniformly for 0 <h <lf 
and lim Xa = X in the mean of order p. 
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M6. If X is continuous at the points of a bounded closed set 
El, then lim Xa = X uniformly on Ei. 

M7. If X is continuous on a neighborhood of Xq and has a 
derivative at Xo, then 

lim Xi(xo) = X'(xo). 

A = 0 

M8. If X is absolutely continuous on each finite interv’-al, 
Xi = (X')a. 

M9. If X is of class and its nth derivative X^’*' is absolutely 
continuous on every finite interval, then == 

(X'^+^Oa. 

MIO. If X is of class then Xa is of class if jEJi is a 

bounded set, lim X^*'^ = X^*^ uniformly on Ei, 

A = 0 

It should be noted that, since Xa(xo) depends only on the values 
of X(x) for Xo ~ A < X < Xo + A, even the properties M8, M9, 
and MIO could be restated as local properties. 

Ml follows from Theorem 29 of Chap. X and Theorem 9 of 
Chap. VI. The absolute continuity of Xa follows from the 
relation 

Xa(&) - Xi(a) = ^ [/+* “ /_* 

and the fact that JX ds is absolutely continuous on every finite 
interval. The validity of (13:2) follows from Theorem 29 of 
Chap. X, and the remainder of M2 from more elementary 
considerations. 

To prove M3 we show first that X(x + s) as a function of two 
variables is in 8p on XS, where S is the interval [—h, X}. For 
any set JS in X, we shall let E* denote the set of all points (x, 5 ) 
such that X + 5 is in X. Then, if £7 is closed, E* is closed relative 
to XS and, if is open, E* is open relative to XS. Thus if i 
is an interval, i* is measurable and, if ^ denotes the character- 
istic function, 

m(i*) = j 0t* dx ds = + s) dx ds = 2ftm(i). 

From this it is easy to see that, if E has measure zero, then 

has measure zero. If cl { x ) is a step function, a(x + 5) is 
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measurable and, if lim a»(x) = \{x) almost everywhere on X, 

n 

lim anix + s) = \(x + s) almost every^\^here on XS, and thus 

” r 

\{x + b) is measurable on XS. Obviously !X(a; + s)l^* dx is 
independent of s, and so by Theorem 4 of Sec. 2, \{x + s) is in 
2p on XS. By Fubini's theorem, lX(a; + 5)1^" ds is integrable 
on X, and since by Holder's inequality, 


(13:3) 


I/: 


\{x + $) ds 


^ (2h)^^ j lX(r + s)\ ^ ds, 


Xa is in 8p on X. 

To prove M4, we have, with the help of Fubini's theorem, 
1/a ^ M 1/ i /a 


^l.u.b. / 
M<i Ja 


\(x + s) dx 


The first part of MS is verified in a similar way with the help of 
(13:3), and then the last part follows from Ml and Theorem 21. 
M6 is proved easily by use of the uniform continuity of X on Ei, 
M7 follows from M2. M8 follows from M2 and Theorem 28 of 
Chap. X. M9 follows at once from M8 by induction, and MIO 
follows from M9, M2, and M6. 

It is easily seen that each time we repeat the process of taking 
integral means, we obtain an approximating function having 
an additional derivative, so that taking integral means is a 
smoothing process. For functions of two variables, we may take 
integral means over rectangles, squares, circles, or some other 
configuration. In two-dimensional potential theory, it is con- 
venient to take integral means over circles, since a harmonic 
function is characterized by the property that it is everywhere 
equal to its integral mean over circles. In studying the differ- 
entiability properties of integral means, it is simpler to use 
squares, and we shall restrict attention to that case. Possible 
extensions to functions of more than two variables will be 
apparent. Some additional properties for functions of two 
variables are listed in a paper by Helsel and Rad6.<^^ 

^ “The Transformation of Double Integrals,” Transactions of the American 
Mathematical Society, Vol. 54 (1943), especially pp. 87-95. 
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The increment A(X; i) of a function. X(x, y) of two variables 
over an interval i = (a, c; b, d) is defined by the formula 

(13:4) A(X; f) = X(6, d) — X(a, d) — X(6, c) + X(a, c). 

Here it is not essential to specify whether an interval is open or 
closed. A set A will be understood to be a finite sum of 

intervals i which are nonoverlapping but not necessarily dis- 
joint. The notation A(X; A) will be used for the sum of A(X; t) 
over the intervals ^ making up A. A set A has infinitely many 
representations as a sum of nonoverlapping intervals, but it is 
readily seen that they all give the same value for A(X; A), A 
fimction \(x, y) is said to be absolutely continuous in case 

lim A(X; A) = 0. If f(Xj y) is an integrable function and 

m(A) =0 

F(x, y) is defined by formula (12:1), then it follows from Theorem 
7 of Chap. X that F{x, y) is absolutely continuous. In other 
words, the definitions of absolute continuity for the set function 

/(^j y) dy dx and the point function F(x, y) correspond. 

It should be noted, however, that the correspondence set up 
by (13:4) between point functions X(x, y) and interval functions 
is not one-to-one, since an arbitrary function of x and an arbi- 
trary function of y may be added to X without changing the values 
of A(X; i). Thus a function X(x, y) may be absolutely continuous 
according to our definition, and yet be discontinuous. Caratheo- 
dory ([4], page 653) in defining absolute continuity for functions 
of two variables adds the requirement that X(a:, y) be absolutely 
continuous in y for one fixed value xo of x, and absolutely con- 
tinuous in X for one fixed value yo of y. Then X is absolutely 
continuous in y uniformly with respect to x, and in x uniformly 
with respect to y, on each finite interval. 

A related but different concept for functions of more than one 
variable is frequently useful. A function X(x, y) of two variable 
is said to be absolutely continuous in the sense of Tonelli in 
case it is continuous, and absolutely continuous as a function of x 
for almost every y, absolutely continuous as a function of y for 
almost every x, and the partial derivatives X* and X*, are inte- 
grable. Like the preceding one, this definition may be applied 
either to a finite interval or to the whole plane. 

As in the case of functions of one variable, we may suppose 
that the functions X(x, y) to be considered are defined in the 
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whole an/-plaiie, which will be denoted by R, and integrable over 
every finite interval. The mean X* is defined by the formula 

'hip, y) — j y i ^ 

, fx-^h ry+K 

It has the following properties: 

Mil. Same as Ml. 

M12. hi is absolutely continuous, and also absolutely con- 
tinuous in the sense of Tonelli, on each finite interval, 
and 

(13:5) ^ L>^(^ + h,t)- Hx - h, t)] dt 

except for a: in a set G of measure zero, and 

|^=^Wx + % + A)-X(a: + A,2/-A) 

-\(x — h,y + h) + 'Kix — — A)] 

almost everywhere. If X is continuous, then X* is of 
class C' and has a continuous mixed derivative, and 
formulas (13:5) and (13:6) hold everywhere. 

M13. Same as M3. 

M14. Same as M4. 

M15. Same as M5. • 

M16. Same as M6. 

M17. If X is absolutely continuous in the sense of Tonelli on 
each finite interval, then 

\dx)h dx ^ \By)h dy 

M18. If X is of class then X* is of class and on each 

bounded set Ei, the partial derivatives of \h up to and 
including those of order n converge uniformly to the 
corresponding partial derivatives of X. 

The proof of Mil is like that of Ml, except that it depends on 
the theorem quoted just preceding Theorem 39 in Sec. 12. For 
M12, we obtain each type of absolute continuity by a manipula- 
tion similar to that for functions of one variable. Formulas 
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(13:5) and (13:6) follow from Theorem 39. The proofs of the 
remaining properties also parallel those for functions of one 
variable. 
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CHAPTER XII 
THE STIELTJES INTEGRAL 

1. Definitions and First Properties. — Stieltjes defined the 
integral known by his name for a special case in a paper published 
in 1894/1^ Various modifications and generalizations have been 
introduced since then by a number of authors. In this chapter 
we shall discuss the definitions that seem to be the most interest- 
ing, as well as the relations between them. The discussion will 
be restricted to functions of one variable. The definitions and 
some of the theorems are extensible to the case of functions of 
two or more variables, but those extensions involve a number of 
troublesome details. 

Let ^ and / be finite real-valued functions defined on the 
interval [a, b], let P be a partition of [a, b] into subintervals 
Xj]j and let points Zj be chosen so that x,*-i g Zj g Xj, Set 
N{P) = maximum of (a;,- — and 

(1 :1) 8iP;i^,f) ^2 = 1 V. 

J 3 • 

When no ambiguity can arise, we may write S(P; yp) or 

merely S{P) in place of /S(P; /). Then, if 

lim 5(P;^,/) 

exists and is finite, it is defined to be the Stieltjes integral of ^ 
with respect to / and is denoted by the symbol 

(-S) f' m df, 

and yp is said to be 5^-integrable with respect to /. We note that 
this differs from the definition of the Riemann integral given in 
Chap. VI only in replacing the length of an interval of the 
partition P by the increment of f{x) over that interval. 

^ See Annales de la faculU des sciences de Toulouse^ VoL 8 (1894), p. J71, 

260 
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The following criterion is obtained at once from Theorem 10 
of Chap. IV. 

Theorem 1. A necessary and sufficient condition for \p{x) to be 
S-integrable with respect to f on [a, 6] is that 

lim [S(P0 - S{P,)] = 0. 

mPi)==o 

i\r(Pi)=o 

A slight generalization of the S-integral has been considered by 
PoUard and others. We shall call it the (?>S-integral. It 
depends on a modification of the limiting process. We shall say 
that a partition Pi is finer than P 2 — ^in notation, Pi 3 P 2 — ^in 
case all the division points for P 2 are used in Pi. The notation 
is suggested by the fact that each partition is determined by its 
points of division. We say that 

lim ;S(P) = L 

in case 

€ > 0 O :3P, 9:P 3 Pe O- !S(P) - < €, 

with the usual modification in case L is infinite. A necessary 
and suflS.cient condition for the limit L to exist and be finite is 
that 

€ > 0 :3:3P, 9;Pi 3 P..P 2 3 PeO' \SiPi) - SiP^)] < e. 

The sufficiency of this condition may be proved by consideriag a 
monotonic sequence of partitions P^, corresponding to a sequence 
of numbers €« with €« tending to zero. 

Now referring back to the sums SiP; f) defined in (1 :1), we 
say that is (?>S-mtegrable with respect to/ when 

lim S{P;i^,f) 

exists and is finite. In this case the limit is denoted by the 
symbol 

(GS) 

The letters (S) and (GS) before the integral sign may be omitted 
when no ambiguity can arise. 

1 See Pollard, ^‘The Stieltjes Integral and Its Generalizations,” Quarterly 
Journal of MathematicSf Vol. 49 {1920--1923) pp. 73-138; Hildebrandt [5]. 



262 


TEE STIELTJES INTEGRAL 


[Chap. XII 


It is easy to see that for either the AS-mtegral or the (?>S-iiitegraI, 
we may replace the functional value in the sum S{P] /) 
by any number between the upper and the lower bound of ^ on 
the interval fe-i, Xj], without changing the force of the definition. 

A Riemann-integrable function is necessarily bounded, but an 
unbounded function ^ may be S- or (r/S-integrable with respect 
to / when / has intervals of constancy. However, in the next 
theorem it is shown that ^ may be replaced by a bounded func- 
tion (depending also on f) such that 

^ df = \pidf (a ^ X ^ b). 

But when integrals with respect to functions of a sequence are 
considered, it is a real restriction to assume that is bounded. 

Theorem 2. Suppose that ^ is S- or GS-integrable with respect 
to /, and let A k) W (—k). Then, when k is sufficiently 

large, we have ^ ^ 

of the S-integral, the points where ^ are contained in a finite 
set of intervals each interior to an interval of constancy of f. In the 
case of the GS-integral, the points where 4^k oire interior to a 
finite number of intervals of constancy of fi 

Proof for the S-integraL — ^There exists a positive 8 such that 

[;S(P) — jT^ d/[ < 1 whenever N(P) <8, HE is the set of 

points at which ^ has an infinite discontinuity, then / must be 
constant on each interval of the open set N{E; 8). This set 
consists of a finite number of intervals, since each has length at 
least 25. We select k so that ^ on the complement of 
N{E; 5/2). Then if N{P) < 5/2, S(P; = S{P; ^). 

Proof for the GS~integral, — ^There exists a partition Pi such 

that when P D Pi, ^S(P) — ^ d/j < 1. Then / is constant 

on each interval of Pi on which ^ is unboimded, and hence when 
k is sufficiently large and P D Pi, S(P; = S(P', ^). 

Theorem 3. The S-integral and the GS-integral ^df are 

linear in f for each fixed and linear in ^ for each fixed f. 

This is obvious from the corresponding properties of limits. 
An operator K(rf^, f) with these properties is called a bilinear 
operator. Note that the domain of as a function of f may vary 
with and vice versa. 
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For the case of the 5-integral, we have the following necessary 
condition for its existence: 

Theorem 4. If is S-integrable with respect to /, then ^ and / 
have no common discontinuities. 

Proof. — Suppose yp and f are both discontinuous at the point c. 
In case / has right-hand and left-hand limits at c, and /(c — 0) 
= /(c + 0) 3 ^ /(c), we choose c as a partition point of a partition 
P with arbitrarily small norm. There is a number e > 0, inde- 
pendent of P, such that on one of the two dosed interv^als 
abutting c, the oscillation of ip is greater than €. Then, if the 
norm N(P) is sufficiently small, we can construct two sums 
5i(P) and 52(P), differing only on one inter\"al, such that 

SiiP) - S2(P) > € ~ 

In aU other cases, there exist a number 5 > 0 and arbitrarily 
small intervals with c as an interior point, such that [A/l > 5, 
where A/ represents the increment over the interval in question. 
There also exists a number e > 0 such that the oscillation of p 
over every such integral is greater than e. Thus for partitions P 
with norm ^^(P) arbitrarily small, we can construct sums 5i(P) 
and S 2 (P) such that 5i(P) — 52(P) > e5. Hence in both cases 
we have a contradiction with the criterion of Theorem 1 for the 
existence of the integral. 

In case / is a step function and p is continuous at the jumps 
of /, it is easily seen that the jS-integral of p with respect to / 
exists. We shall consider the case when / has only one jump, 
say at the point c. Then for every partition P, S(P) = 
PiO [/(<5 + 0) — fic — 0)] and, when N(P) tends to zero, S(P) 
tends to the value p{c)\f{c + 0) — fic — 0)]. 

For the G5-integral, the situation is slightly different. 

Theorem 5. If p is GS~integrable with respect to /, then p and f 
have no common discontinuities on the rights nor on the left. 

Proof. — Suppose p and / are discontinuous on the right at c. 
Then there exist a number € > 0 and points zi, Zs, and d arbi- 
trarily near c, with c^zxKzz^d, such that |/(d) - /(c) ] > €, 
\Pizi) — Piz^\ > €. Hence for every partition P with c and d as 
successive partition points, we may cho(^ sums 5i(P) and SdJP) 
such that 5i(P) -- 52(P) > From this it follows that p is 
not (?5-integrable. 
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Now let j{x) = 0 for a g rc ^ c, S{x) = 7 for c < a: g Z>, and 
let ^(x) be continuous on the right at c. Then it is easily seen 

that (G/S) j[ ^ exists and has the value The extension 

to other cases is obvious. 

Theorem 6. When a function ^ is S-integrahle with respect to /, 
it is also GS-integrable, and the two integrals are equal. 

This is an immediate consequence of the definitions. Theorem 
4 and the remark preceding Theorem 6 show that the converse 
is not true. However, we can prove the following result: 

Theorem 7. When rp and f are hounded and have no common 
discontinuity and ^ is GS-integrable with respect to /, it is also 
S-integrable, 

Proof, — By hypothesis, corresponding to an arbitrary € > 0, 
there is a partition Pe such that for every refinement Pi of 
we have 

(1:2) \s{Pi)- f^df\<,. 

Let yi, • • • jVt be the division points of P„ where a < y,- < b, 
and let M S |<^(a:)i, M |/(a:)I. Then there is a number 5 > 0 
such that, if |a: — yj\ < 5, we have 

, \4f(x) — ^(y;)l < e/2Mg if is continuous at yj, 

^ ^ l/(a;) ~ f iyd l < el^Mq if if- is discontinuous at y,-. 

Now let P be any partition with N(P) < S and let Pi be the 
partition formed by using all the division points of P and P.. 

If S{P) = -/(x*_i)], we may choose the func- 

tional values of ^ for >S(Pi) so that 5^ (Pi) — S{P) reduces to at 
most q terms of the form 

[4'{yi) - ^(z*)][/(«j) - fivj)], 

where one of the values Wj, Vj' is yj and the other is either Xh or 
Xa- 1 , and where yj is in the interval [xk^i, xj. Then by (1:3), 

l^(Pi) ~ S(P)1 < 6 , and hence by ( 1 : 2 ) |/S(P) ~ ^ V d/| < 26 . 

Suppose ^ is /S-integrable or G/S-integrable with respect to / 
on the interval [a, 6 ], and let [c, d] be a subinterval of [a, b]. 
Then \p is integrable in the same sense on [c, d], as is easily shown 
by use of the Cauchy condition. On the other hand, if ^ is 
G5-integrable with respect to / on [a, 6 ] and on [&, c], it is so on 
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[a, c]. But Theorem 4 shows that this result does not hold for 
the S-integral. 

fh 

Theorem 8. Integration by parts. When {S) I ^ df exists, 

fh 

(S) [ / dyp also exists and 

(S) I' 4' df + (s) jlfd4> = mm - mm. 

The same relation holds for the GS-integral, 

Proof , — ^Let 


siP;f, = 2 mmx,) - fixi-i)], 

i=i 

n n 

= 2 + 2 mmxi) -fm, 

i=l 3=1 

where Xo = o, rCn = b. We note that the partition Pi is obtained 
from P by using all the points Xf and Zf as points of division. 
When Zf = Xj or Zf = Xf-i, the corresponding teim in the sum 
drops out. Obviously Pi is finer than P, and N(Pi) ^N{P). 
Also 

B{Pu /) + s{P)f, 4d = mfQ>) - mm. 

By taking limits, we obtain the conclusions desired. 

The next theorem motivates the restriction that is commonly 
made that the function / be of bounded variation. But the 
theorem on integration by parts shows that the Stieltjes integral 
may exist in important cases when / is not of bounded variation. 

Theorem 9. If every continuous function 4/ is GS-integrahle 
with respect to f, then f is of bounded variation. 

Proof , — Suppose f is not of bounded variation on the interval 
[a, b]. Then by the method of successive subdivision, a point X 
may be determined such that for every interval [c, d[ to which 
X is interior, f is not of bounded variation on [c, d]. In case X 
is at a or at &, the requirement of interiority is waived. Hence / 
fails to be of bounded variation on every interval [X, d], or else 
/ fails to be of bounded variation on every interval [c, X]. For 
definiteness, we consider the latter case and suppose first that 
\f(x) I ^ M on 2 b left-hand neighborhood of X, Then there exist 
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points Co, Cl, • • • , Cp,, ■nith a = Co < Ci < • • • < Cp, < Z, 
kOi S M, and 


2 l/(cf) - + i/W - S(fipd\ > 2M + 1. 


Hence 


.! 

/=1 


!/fe) > 1. 


The process may be repeated for the interval X\. By a 
sequence of such repetitions we obtain an increasing sequence of 
points c, approaching X, and an increasing sequence of integers 
Paj, such that 


(1:4) 


29^1 

i=p*+l 


If we let Tji — 1/& for pfc-i < i ^ Pk, we have 


(1:5) 2 = +«>. 

j-i 

In case / has an infinite discontinuity on the left at X, it is easy 
to see that we may still obtain (1:4) and so (1 :5). 

Now set 


Hcf) = Vi sgn [/(c,-) - f(cj^i)], 

^(x) = \p{ci) for a ^ X ^ ci, 

i/{x) = 0 for X ^ X ^ bj 

and extend to be continuous on [a, b], for example, by making 
it linear in the intervals where it is stiU undefined. Whenever 
[cj-x, c^] is an interval of a partition P, we may take 

Homed -fioi-i)] = m\m ~/fe-i)i 

as the corresponding term of S{P). Hence for p > 0 and an 
arbitrary partition Pi we can find a finer partition P such that 
S(P) > p, simply by using enough of the points c,- as partition 
points. Then ^ is not (j>S-integrable with respect to /. 
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The accompanying figure illustrates a simple case when the 
G/S-integral exists but the /S-integral does not. It also illustrates 

1 ^ 



the formula for integration by parts. The area bounded by 
ADEGKLNP equals df, and the area bounded by CBD- 

EGKLNQ equals The definition of the /S-integral is 

inadequate to decide between HKL and HML as possible parts 
of the boundary. If the point S were a point on the graph of 
yf/ix) in place of jB, the definition of the ff^-integral would also be 
inadequate to decide, but the L^S-integral (to be discussed in 
Sec. 3) would decide for HML in the case of df and for HKL 
in the case of //#. From this we see that the formula for 
integration by parts does not always hold for the L>S-integraL 
2. Functions of Bounded Variation. — ^We have seen in Chap. 
X, Sec. 5, that if fix) is of bounded variation on [a, b] and t(x), 
p(x), nix) are, respectively, its total, positive, and negative 
variations, then 


(2:1) f(x) = f(a) + pix) - n(x), tix) = p(x) + n(x). 
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The decomposition (2:1) of /(a:) into the difference of two non- 
decreasing functions is a minimum decomposition, in the sense 
that, if /(a;) = g{x) — h(x) where g and h are nondecreasing, then 
for every subinter\' al of [a, b] we have Ap ^ Ag, An ^ Ah. For 

Ap + An = At ^ Ag + Ah, 

Ap — An = Ag — Ah. 

By adding we obtain Ap ^ Ag, and by subtracting we obtain 
An ^ Ah. 

A function / of bounded variation may also be decomposed 
into its continuous part and its jump function. We may suppose 
that / is nondecreasing, and then the two expressions 

^ u(c + 0) - mi 

a^c <h 

X Uic)-fic~0)l . 

a<c^h 

have no negative terms and at most a denumerable infinity of 
positive terms, so they represent finite or infinite series which 
will remain convergent if some of the terms are omitted. Let 

(2:2) j{x) = ^ [/(c + 0) - /(c)] + 2 [fic) - f(c - 0)]. 

a^c<x a<eSx 

Then j(a:) is nondecreasing. It also has exactly the discontinui- 
ties of /. For by taking 5 sufficiently small, the series j{x + d) 

— j(x) may be made to exclude any finite set of terms of the 
series foi j{b) except the term [f(x + 0) — f{x)]j so that^X^ + 0) 

— j{x) = f{x + 0) — f{x). The same argument holds for left- 
hand discontinuities. Then g{x) = f{x) — j{x) is continuous 
and is also nondecreasmg, as is easily verified. A jump function 
is characterized by the fact that it is the sum of an absolutely 
convergent series of step functions, each of which is discontinuous 
on only one side of a single point, and vanishes at a: = a. In 
such a series, teims having the same discontinuity on the same 
side may be grouped together. We see that after such a group- 
ing a discontinuity of the sum of the series is exactly the dis- 
continuity of some one of the terms, so that the function defined 
by the series is its own jump function as defined above. 

If p and n are the positive and negative variations of /, the 
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jump functions of p and n are, respectively, the positive and 
negative variations of j, since each jump of p is a positive jump 
of / and hence of j. From this we find that, if g = f ^ the 
total variation of / is the sum of the total variations of g and j. 

Still another decomposition of / is that into its absolutely 
continuous part and its function of singularities. The derivative 
f{x) is Lebesgue-integrable, by Theorem 30 of Chap. X, and 

f dx is absolutely continuous. The function 
s(x) = f{x) ~ /(a) - f dx 

is called the function of singularities of f(x). It is identically 
zero if and only if / is absolutely continuous. The jump function 
of / is included in the function of singularities. 

The class of functions of bounded variation is linear and, if / 
and g are two such functions, we have 

tcdif + ^ ^cd(f) + tedio), 

-where the notation Udif) is used temporarily to denote the total 
variation of / over the subinterval [c, d]. From this we may also 
deduce the inequalities 

/n.o\ ^cd(J) W(p) ^ ted(J Q) j 

^ ^ tcd[iax(f) — tax(g)] ^ tcdij “ Q) • 


3. Further Definitions and Relations between Integrals. — The 
upper and lower integrals of ^ with respect to / are useful when / 
is a nondecreasing function. Under this restriction we may set 

Uj = l.u.b. \(^(x) on [Xj^i, XjJj 
Lj = g.l.b. on [xj^i, Xil 

-Aif, 

df = g.l.b. S*(P; f), 


Here it is imderstood that 0* =0, so that the upper and lower 

integrals may still be finite even when ^ is unbounded. As 
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elsewhere in this chapter, / is assumed to take only finite values 
on the closed interval [a, &]. 

J£ Pi and P 2 are arbitrary partitions of [a, b] and P 3 is the parti- 
tion formed by using all the points of both Pi and P 2 , we see at 
once that 

(3:1) S^iPz) g >S*(P3) ^ S^(P,) ^ S%Pi), 

and from this it follows at once that 

(3:2) f'Hx)df^ f'Hx)df. 

Theoeem 10. A necessary and sufficient condition that f be 
GS-integrable with respect to a nondecreasing function f is that the 
upper and lower integrals of ^ with respect to f be equal and finite. 
The common value of the upper and lower integrals then equals the 
GS-integral of yp with respect to f. 

This theorem is easily verified by use of the fact that, when 
additional partition points are inserted in P, the sums ;S*(P) do 
not increase, and the sums S^(P) do not decrease, so that 

P ^ df = lim S*(P), r ypdf = lim S*(P). 

P,D 

CoEOLLAEY. Another necessary and sufficient condition is that 
for every e > 0, there exists a partition P such that ;S*(P; /) and 

S*iP; f, f) are finite and, S*{P] f,f) — S*(P; f,f) < e. 

Theohem 11 . A necessary and sufficient condition that ^ be 
S-iniegrable with respect to a nondecreasing junction f is that 

lim mP-,hf)-S*{P;j^,m = 0. 

Proof. — To prove the sufficiency of the condition, we note that, 
since S*(P) < + «> and ;S*(P) > — « , it is clear that both 
must be ffiiite when N(P) is sufficiently small. From (3:1) it 
follows that the intervals [-S*(Pi), £^*(Pi)] and [S*(P 2 ), S*iP 2 )] 
always have at least one common point. If each of tiiese 
intervals has length less than e, then i/Sf(Pi) — ^^(Pa)! < 2e, since 
S(Pi) always lies in the first interval and S{Pi) in the second. 
Thus Theorem 1 3 delds the sufficiency of the condition. The 
aecessity follows from the observation that the value of SiP) 
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may be made arbitrarily close to either /S*(P) or S^{P) by a 
proper choice of the points Zj, 

Still using the restriction that /is nondecreasing, we may obtain 
a measure function m/(^) defined for all subinterv^als i of [a, &], as 
was indicated at the beginning of Chap. X. Then the processes 
of that chapter 3 deld the / measure m/(P) and the Lebesgue- 
Stieltjes or LS-integral. Some further properties of that integral 
and its relations with the S-integral and the G/S-integral will be 
developed in this chapter. 

It is easily seen that, when / is a nondecreasing jump function 
having only a finite number of jumps, and is single- valued and 
finite at the discontinuities Cj of /, then the Lebesgue-Stieltjes 


n 



3 = 1 


\j{Cj + 0) — /(Cj — 0)]. This agrees with the value of the 
GS-integral when it exists. 

Various further modifications of the integral of Stieltjes 
have been considered by a number of authors. The reader 
is referred to the papers of Hildebrandt ([4], [5]) which contain 
bibliographies. 

Many of the following theorems contain three theorems, stated 
simultaneously for the ^-integral, the G>S-integral, and the 
LS-integral. 

Theorem: 12. Let f and g he nondecreasing junctions^ with 
Af ^ Ag on every subinterval. If 

j'i'dS 

exists as an >S-, OS-, or LS-integral, then 

(3:3) 1^4'dg 

also exists in the same sense, and when \l^ ^ 0, we have 

(3:4) l^^^dg^jydf. 

Proof for the GS-integral . — It is easily seen that S*{P; g) is 
finite whenever S*(P; f) is, with a corresponding relation for S*, 
and that 

(3:5) S*{P; g) - /S*(P; g) ^ S*{P;f) - S*{P;f) 
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for every partition P. Hence the existence of (3 :3) follows from 
the Corollary’ of Theorem 10. WTien ^ 0 we have jS*(P; g) 
g S^{P]f)j and from this inequality (3:4) follows. 

Proof for the S-Integrah — This case follows i mm ediately from 
Theorem 11 with the help of (3:5). 

Proof for the LS-integral — Suppose first that ^ is bounded, and 
let (a„) be a bounded sequence of step functions converging to ^ 
except on a set E with m/(P) = 0. Then mg{E) = 0, and hence 
there exists 

J fb 

' \l/dg = lim 

“ n 

When ^ ^ 0 , we may suppose (Xn ^ 0 , and so obtain the inequal- 
ity (3:4). In case lA is unbounded, suppose ^ 0, and let 

== ^ A w. Then 

f dg S f df ^ f yp df, 

and so the desired result follows from Theorem 12 of Chap. X. 

As was indicated in Theorem 3, the AS-integral and the G^AS-inte- 
gral are bilinear operators. To obtain a similar result for the 
I/AS-integral, we need the following property: 

Lemma 1. Suppose that g and h are nondecreasing functions 
and that ^ is LS-integrahle with respect to g, and also with respect 
to h. Then ^ is LS-integrahle with respect to f 9 + hj and 

(3:6) fypdf=^ffdg+f"ypdh. 

Proof. — Suppose first that 4' is bounded. By Lemma 3 of 
Chap. XI there exist functions and v-+ from the class 
and and v+~ from the class such that 

(3:7) g g ju+~, ir-^ S ^ 

(3 :8) f fi-^ dg = fxpdg= f n+- dg, 

(3:9) f dh = f 4/ dh = f dh. 

Let X-+ = V V-+, X+- = A V+-. Then is in 
X"!" is in 3JJ+— , and hence each is measurable with respect to /. 
Also X~+ may be substituted for ju“+ and v~^, and may be 
substituted for and v+- in (3:7) to (3:9). Since (3:6) holds 
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for step functions, it holds for all functions in and 
Hence by the converse part of the lemma just quoted, ^ is meas- 
urable with respect to / and (3 :6) holds. In case ^ is unbounded, 
we may suppose ^ ^ 0, and let ypn = -ip A n. Then, by the 
result already proved for the bounded case, 

^ i'ndf = }pndg + ypn dk. 

Theorem 12 of Chap. X then shows that rp is integrable with 
respect to /, and (3 :6) continues to hold. 

We extend the definition of (I//S) df to the case when / is a 
function of boimded variation but not monotonie by means of a 
minimum decomposition /(a;) = p{x) — n(x), where p and n are 
nondecreasing. We define 

(3:10) (LS) 4' df== (LS) // 4^ dp - (LS) 4' dn, 

when both integrals on the right exist. 

When gi{x) and g 2 (x) are nondecreasing and f(x) = gi(x) 
— g 2 (^)) then 

j^4'df= f^4'dgi- J^4'dgi, 

whenever the integrals on the right exist. For, we always have 
Agi ^ Ap, Agz ^ An, as was shown at the beginning of Sec. 2. 
Hence the integrals on the right of (3:10) exist, by Theorem 12. 
Then by the lemma just proved, 

4^ dp + ^ dg2 = i'dn + Tp dgi. 

It is now easy to verify the following result: 

Theorem 13. The LS-integral J\p df is a bilinear operator. 

The next theorem will justify our restricting attention to 
nondecreasing functions / in certain later proofs. 

Theorem 14. Let p{x) he hounded and f{x) he of hounded 
variation^ and let t{x), p{x), and n{x) he, respectively, the total, 
positive, and negative variations of f. Then a necessary and suffi- 
cient condition that 4^ df exist as an S-integral, GS-integral, or 

LS-integral is that f yp dt exist in the same sense, A second 
necessary and sufficient condition is that / 4' dp and / ^ dn 
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exist in the same sense. The condition that ^ he bounded is to be 
omitted in the case of the LS-integral. 

Proof . — For the case of the LS-iiitegral, the statement follows 
directly from the definition and Theorems 13 and 12. To prove 
the necessity of the first condition in the case of the (r^'-integral, 
we note that for an arbitrary e > 0, there is a partition P such 

that we have simultaneously \f/df — S(P; /)j ^ e, and 
m — ^ l/fe+i) — f{xi)\ ^ €. From the first of these inequali- 

ties we find that Y (Uj — Li)\f(xiJ^i) — /fe)j ^ 26, where U] and 
j 

Lj have the meanings indicated at the beginning of this section. 
If 1^(1) 1 g M on [a, 6], 

^ (C7f - mixrn) - t{xd - 1/fe+i) - fix,)\] 

^ 2M[tib) - 2 IM+i) -m\] g 2Me. 

Hence ^ (J7,- - LiMzi+i) - Kxi)] ^ 2(ilf + I)*. Thus by The- 

J 

orem 10, \[/ is 6^5-integrable with respect to t. The necessity of 
the second condition follows from Theorem 12. The sufficiency 
of the conditions then follows from the linearity of the integral. 
To prove the conditions for the ^-integral, we recall that f{x) 
and t(x) have the same discontinuities. Since ^ was assumed to 
be bounded, Theorems 6 and 7 are applicable to obtain the desired 
result. 

Theorem 15. Suppose that fix) is a function of bounded 
variation and that ^i(x) and i/^ix) are bounded and S~j GS-, or 
LS-integrable with respect to f. Then the functions ^3 = lAi V ^2, 
^4 = A ^2 cmd IV'il dre integrable with respect to f in the same 
sense. The condition that and ^2 cere bounded is to be omitted 
in the case of the LS-integral and, when f is monotonic, also in the 
case of the S- and GS-integrals. 

Proof . — ^By the last theorem, we may restrict attention to the 
case when / is nondecreasing. For the L5f-integral, the result 
was obtained in Theorem 8 of Chap. X. For the /S- and (r^S-inte- 
grals we may apply Theorem 11 and the Corollary of Theorem 
10, respectively. For the oscillation of ^3 on a given interval 
is not greater than the sum of the oscillations of and ^2, and 
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hence 

S*(P; ^3) - S^(P; ^3) g S*(P; W - S^(P; ^i) + S*(P; ^ 2 ) 

-S^(P;4.2y 

A corresponding inequality holds also for ^ 4 - Since j^l = 
^ V (~^), the result for |^il follows from the linearity of the 
integrals. 

Theorem 16. Suppose that the functions f and h satisfy the 
inequality [A/] ^ AA on eioery suhinterval, where h is a nondecreas- 

fh 

ing hounded function. If I \l/ dh exists as an S-, GS-, or LS^^inte- 
rb 

gral, then I f/ df exists in the same sense, and 

(3:11) r WdA. 

Proof . — If tix) is the total variation function of /, we have 
At ^ Ah, so that the existence of ^ df follows from Theorem 
12 and the linearity of the integral. 

To obtain the inequality (3:11), let p{x) and n(x) denote, 
respectively, the positive and the negative variations of /, and 
let ^1 = ^ V 0, ^2 = — (^ A 0). Then 

\fa ^ M - la fa f^ fl 

= llf-I dt g lif'I dh, 

by the bilinearity of the integral and inequality (3:4). 

• Corollary. Suppose f{x) is of bounded variation, ^(x) is S-, 
GS-, or LS-4ntegrahle with respect to f, and l^(x)| ^ M. Then 

iXVd/| g MtQ>), 


where iQ)) is the total variation of f{x) on [a, 6]. 

Theorem 17. Suppose that each function gn{x) is nondecreas- 
ing and that the series ^ gn{a) and ^ grffy) converge. Then the 

series ^ gn(x) converges uniformly on [a, 6] and defines a nondecreas- 
ing function fix). Necessary conditions for the existence of 
f/ df as an S-, OS-, or LS-integral are 
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(i) All the integrals ^ dg^ exist in the same sense; 

(ii) The series ^ Iv^] dg^ converges; 
and then we have 

( 3 : 12 ) ja 'f' ^ 1, la 

For the LS-integral, these conditions are also sufficient. For the 
S- and GS-integrals a set of sufficient conditions is obtained by 
replacing (ii) by the stronger condition that yp is bounded. 

Proof . — The uniform convergence of ^ gn(x) follows from the 
inequality 

gr^ix) - gn(a) ^ gnib) - gn(a). 

The necessity of the conditions follows from Theorems 12 and 15 
and the relations 


(3:13) f df ^ // [^1 (Z ( J J = 2 r 

\n = 1 / 71 = 1 


In the case when \p is bounded, the equation (3 :12) follows from 


the Corollary of Theorem 16, with / replaced by 



When yp is unboimded, we may suppose ^ ^ 0, and set ypk = 
\p A k. Then 


00 eo 

fa X la Ja 

71=1 71 = 1 


But by Theorem 2 for the S- and G*(S-mtegrals, and by Theorem 12 
of Chap. X for the L5^-integral, 

so that 

I ffdg^ 

71 = 1 


But this with (3:13) above yields the desired result. 

Proof of Sufficiency for the 5- and GS-integrals . — If L S yp ^ U 
and € > 0, we may choose an integer q such that 
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(U-L) y 

and hence 

CO 

n=s+l 

for every partition P. But 

Q 

S%P;f) - &(P;/) = 2 [-S*(P;^,) - S^(P;g„)] 

n = l 

00 

+ 2 mP; 9n) - S*(P; g,d]. 

n = a+l 

The desired result now follows by application of Theorem 11 
for the jS-integral, and of the Corollary of Theorem 10 for the 
G/S-integral. 

Proof of Sufficiency for the LS-integral . — We take first the case 
when is bounded. Then by Lemma 3 of Chap. XI there exist 
functions Hn from the class and Vn from the class 
having the same bounds as such that 

(3:15) ^ Vn, llndgn fa dg^. 

Let ju(a;) = l.u.b. ^n(x), v{x) == g.l.b. v^ix). Then g. and v are 
Borel-measurable and 

(3:16) 

and so 

(3:17) fydgn = Si^dgn = fvdg^^ 

By the first part of the theorem, since y and v are LiS-inte- 
grable with respect to /, 

1 £i^d9n= t 

n=l 

fy^f= t t 

n»l ns=l 
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and hence by Lemma 1 of Chap. XI, = v — almost everj’'- 
where with respect to /, and so ^ is L/S-integrable with respect 
to /. When \p is unbounded, we may suppose ^ ^ 0. Then the 
inequality (3:14) with Theorem 12 of Chap. X shows that ^ is 
LS-integrable with respect to /. 

Corollary. Let f{x) be of hounded variation and let j(x) be 

its jump function, defined by formula (2:2). Then yj/ dj exists 
(i) as an LS-integral when the series ^ ^(c)[/(c + 0) /(c)] and 

^ ^(c)[/(c) — f{c — 0)] are both absolutely convergent; (ii) as a 

GS-integral when rp is hounded and ip and f have no common dis- 
continuities on the same side; (iii) as an S-integral when yp is 
bounded and yp and f have no common discontinuities. In each case 

i'dj = ^(c)[/(c + 0) - /(c - 0)]. 

We can now obtain necessary and sufficient conditions for the 
existence of / yp df as an ^^-integral or as a G/S-integral, under 

the assumption that yp is bounded and / is of bounded variation. 
Let D denote the set of discontinuities of yp, t(x) the total variation 
of f{x), and t(x) the total variation of g{x) = f(x) — j{x), where 
j{x) is the jump function of f{x). Let rrit and denote the 
measures associated with the nondecreasing functions t{x) and 
t(x), respectively, by the processes of Chap. X. 

Theorem 18. Suppose that yp is bounded and f is of bounded 

variation. Then 'Pdf exists (i) as an S-integral if and only if 

mt{D) = 0; (ii) a OS-integral if and only if mr{D) = 0 and yp 
and f have no common discontinuities on the same side. 

Proof. — By Theorems 4 and 5 and the Corollary of Theorem 17, 

the existence of ypdf m either sense implies the existence of 

^ ypdj in the same sense, and consequently that of yp dg. 
Also if Ti(x) denotes the total variation of j(x), t — r + n, 
rrtt ^ mr + m^, and hence mt(D) = 0 implies the existence of 

(S) yp dj. Thus it is sufficient to consider the case when f(x) 
is continuous, and then the distinction between the /S-integral 
and the G/S-integral disappears, by Theorems 6 and 7. By 
Theorem 14 we may further restrict f(x) to be nondecreasing. 
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Now let (Pn) be a sequence of partitions, each obtained from the 
preceding by further subdivision, and set 

= 0 if a; is a partition point of Pn, 

= oscillation of ^ on the interval of P„ containing x, for 
all other values of x. ' 

Then the sequence of step functions ojn is nonincreasing and 

bounded, and hence \{x) = lim (aj^x) is nonnegative andi>S-inte- 

J rh rb 

' X df = iim / cj)n df. But 

a ^ Ja 

o>n df=: S*(Pf^ — S*(Pn), aud it follows with the help of the 
Corollary of Theorem 10 that ^ is ff/S-integrable with respect to f 
if and only if there is a sequence (P») such that lim / osndf = 0. 

n 

By Lemma 1 of Chap. XI the last statement holds if and only if 
X = 0 almost ever 3 rwhere with respect to /. Since the set of all 
the partition points of the Pn forms a denumerable set, it may be 
neglected, so that X = 0 almost everywhere with respect to / if 
and only if mf{D) = 0. 

Theorem 19. Suppose that f is of hounded variation^ and ip is 
/S- or GS-integrable with respect to /. Then p is also LS-integrahle, 
and the integrals have the same value. 

Proof. — The bounded function ipk of Theorem 2 in Sec. 1 is 
equal to p almost everywhere with respect to the total variation 
function t{x) of /, so that we may suppose p is bounded. As. in 
the proof of Theorem 18 we may also restrict attention to the 
case when / is continuous and nondecreasing, and then the proof 
is the same as that given for Theorem 14 of Chap. X. 

We shall close this section with some theorems relating to 
change of integrator. If d{x) is Lfif-integrable with respect to 

h{x), we note that g{x) = 6 dh may fail to be well-defined at 

points of discontinuity of h(x). For convenience in what follows 
we define g{x) at every such point c so that 

- gio - 0)][h{c + 0) - h{c)] 

= lg(c + 0) - g{c)][hic) - h{c - 0)]. 

Lemma 2. Let h{x) he nondecreasing, and let 6{x) he nonnega- 
tive and LS-integrable with respect to h. Let g{^) — ^ dh. 
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Then, if mh(E) = 0, also mg(E) = 0. If mg{E) = 0, then B{z) = 0 
almost eoerywhere with respect to h on E. 

Proof . — If C is a sum of intervals, we note that mg{C) = 6 dh. 

Since J 6 dh is absolutely continuous with respect, to h, for each 
€ > 0 there is a 5 > 0 such that mg(C) < e whenever mh(C) < 8. 
From this the first part of the Lemma foUows at once. Similarly 

we find that when mg(E) =0, 6 dh = 0, and so the last part 

follows from Lemma 1 of Chap. XII. 

Theorem 20. Let f(x), h(x), and k(x) be nondecreasing, and 
let B{x) he nonnegative and LS-^integrable with respect to h. Suppose 

that ^ is LS-integrahle with respect to f and that f{x) = j^Bdh 
+ k(x). Then \I/B is LS-integrable with respect to h, and 

df = 4^B dh rp dk. 

Proof . — Let g(x) = ^ dA. By Theorem 12, ^ is integrable 

with respect to g and to k. If (a«) is a sequence of step functions 
converging to ^ almost everywhere with respect to g, we have 
lim a^B = ^B almost everywhere with respect to h, by Lemma 2. 

fir t 

fb rb 

Since I a dg — aB dh for every step function a, we have 
rb fb 

/ i/dg ^ I tI^B dh when ^ is bounded, by Theorems 11 and 7 

of Chap. X. The formula is extended to the unbounded case 
by the usual device, using Theorem 12 of Chap. X. 

Corollary. If f(x) is absolutely continuous, and ^/{x) is 
LS-integrable with respect to f, then 4f{x)f{x) is Lnintegrable, and 

I'fdf = I'^'f'dx. 

Here we use the term ^'L-integrable^^ in place of '^LS-inte- 
grable with respect to x” 

We have already noted in the Corollary of Theorem 17 that 
f^df reduces to an infinite series when / is a jump function. 

Theorem 21. Let h(x) be nondecreasing, let B{x) he LS-inte- 
groble with respect to h, and let f{x) = ^ dh. Suppose that 

if{x) is S~, OS’-, or LS-integrable with respect to h, and that either 
or B is hounded. Then ^ is integrable in the same sense with 
respect to f, provided f is properly defined at the discontinuities of h. 
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Proof , — When d is bounded, this follows from Theorem 16. 
For the remaining case, we may suppose ^ ^ 0 and, if necessary, 
we may decompose h into its continuous part and its jump 
function. For the S- and G/S-integrals, the result follows from 
Theorem 18 and Lemma 2. With the help of Lemma 2 the proof 
for the I/S-integral is hke the corresponding part of the proof of 
Theorem 12. 

An important special case of Theorem 21 occurs when h(x) = x 
and f(x) is absolutely continuous. The example ^(x) = ^(x) 
= shows that we cannot allow both ^ and 6 to be unbounded 
without some other restriction. However, it is easily seen that, 
whenever ^ is measurable with respect to /z, it is measurable with 
respect to the total variation of /. 

4. Convergence Theorems. — In this section we shall consider 
various sets of conditions justifying interchange of order of 
integral and limit, as well as some examples in which such an 
interchange is not valid. By Theorem 13 of Chap. IV, it is 
sufficient to consider the case of sequences of functions. 

Since in many cases the variable x will not need to be written, 
we may conveniently use the notation t(f) for the total variation 
function i(x) of /(x). 

Following are the conditions from which the hypotheses of 
Theorems 22 to 28 wHl be selected: 

Ai. The functions gjc{x) and/(x) are of bounded variation. 

As. The functions gk{x) and /(x) are of uniformly bounded 
variation. 

As. There is a nondecreasing function h{x) such that gr*(x) 
and /(x) satisfy the inequalities \Agk\ ^ AA, lA/[ g Ah on 
every subinterval of [a, &]. 

A4. The functions gk(x) and /(x) are absolutely continuous 
uniformly in k, 

Bi. There is a set E dense on [a, h] and including the points 
a and &, such that lim gk{x) = /(x) on E. 

k 

B2. lim t{gh — /) = 0. 

k 

Bs- Qk = f for each k. 

Cl. The functions fn(x) are S-, GS-, or LS-integrable -with 
respect to each function gk{x). 

C2. The functions fn(x) are S-, GS-, or LS-integrable with 
req)ect to h(x). 
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C3. The integrals dh are absolutely continuous T\uth respect 
to h uniformly in n, and bounded uniformly. 

C4. The functions Tpnid) and 6(x) are bounded 'v\ith respect to 
X and n. 

Cs. The functions and d(x) are continuous on [a, 6]. 

Di. lim ypn — B almost everyiv^here Tvith respect to each 

n 

function t{gk)- 

D2. lim i/n — 0 almost everywhere with respect to h, 

n 

D3. lim yj/n — 6 uniformly on [a, &]. 

n 

D4. ypn — B for each n. 

We are interested in the validity of the formula 
(4:1) lim [ dgk = C 6 df, 

fist 09 d 

00 

where the integrals exist in a suitable one of the three senses 
which we are considering. When either B3 or D4 holds, the 
double sequence reduces to a simple sequence. Theorems for 
these cases are needed as preliminaries to the treatment of the 
double sequence. Theorem 22 is sometimes known as the Helly- 
Bray theorem. 

Theorem: 22. A2, Bi, Cs, D4 imply (4:1), where the integrals 
are S-integrals. 

Proof , — If P is a partition of [a, b] into intervals xy], let 
6>(P) denote the maximum oscillation of 6 on an interval of P. 
Since 0 is uniformly continuous, lim a)(P) = 0. Let 

iV(P)=0 

SiP; 9, Qk) = Y, 9{zj){gk{x,) - gk{xj-i)]. 

Then 

(4:2) \S{P; 6, gk) - // 6 g [dizi) - 6(0:)] 

^ (i>{P}t(gk), 

by the Corollary of Theorem 16. 

Hence lim S(P; 8, gk) = f 8 dgk uniformly with respect to k. 

W(P)=0 

When the partition points of P are required to belong to the set 
we have lim S{P-, e,gk) — ^>(P;0,/), provided the same points 

ft- « 
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are used in all the sums corresponding to a given partition P. 
Since the integrals are knovm to exist, vre may restrict attention 
to a particular sequence of partitions and corresponding points 
Zj. Hence the desired conclusion follov's from Theorem 2 of 
Chap. VII. 

Theoeem 23. A 2, Bi, C5, Ds imply (4:1), where the integrals 
are S-integrals. 

Proof. — By the Corollary of Theorem 16, lim f ipn dgu 

= iiniformly with respect to fc. Then from Theorem 22, 

and Theorem 2 of Chap. VII, we obtain the desired result. 

This theorem could also be proved directly from the inequality 
analogous to (4:2) for the sums S{P; gk), since the functions 

are equicontinuous by Theorem 24 of Chap. VII, Sec. 4. 

Theokem 24. The function 6 is S-, GS-, or LS~integrable with 
respect to f, and (4:1) holds, if Ai, B3, Ci, C4, D3 hold. 

Proof. — For the case of the I/jS-integral, this was proved in 
Chap. X. For the other cases, we note that every discontinuity 
of ^ is a discontinuity of some on the same side. Then 
Theorem 18 shows that d is integrable in the proper sense, and 
(4:1) follows from the Corollary of Theorem 16. 

Theoeem; 25. The function 6 is S~, GS-, or LS-integrable with 
respect to f, and (4:1) holds, if At, B2, Ci, C4, D4 hold. 

Proof. — The equality (4:1) follows from the CoroUary of 
Theorem 16 whenever it is known that fd df exists. To prove 
the existence in case of the 5-integral, let D denote the set of 
discontinuities of 6. Then by Theorem 18, the measure of D 
with respect to the total variation of Qk is zero. The total varia- 
tion of (/ — Qk) over an arbitrary sum of nonoverlapping inter- 
vals is not greater than t(f — gk) over [a, 6], and so approaches 
zero with 1/k, Since t{f) ^ t(f — gk) + t{gk) over every interval, 
the total variation of / over the set D must also be zero, so that 
(5) Jd df must exist, by another application of Theorem 18. 

To prove the existence in case of the (?5-integral, let jk and jf 
denote the jump functions of gk and of /, respectively, and let 
hk — gk jkj hf = f — Then by the results of Sec. 2, 
t(f - Qk) r + ^0/ - h), so that lim t{kf - hk) = 0. 

k— 00 

By the proof in the last paragraph, Jd dhf exists. Every dis- 
continuity of / is a discontinuity of some gi, on the same side, 
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since gk{x) — gk{d) approaches j{x) — /(a) uniformly on [a, b]. 
Hence $ and f have no common discontinuity on the same side, 
so that (GS) Jd df exists, again by Theorem 18. 

When 6 is bounded and Borel-measurable and / is of bounded 
variation, {LS) Jddf always exists. When 6 is not Borel-measur- 
able but is LiS-integrable with respect to each gkj we may show 
that it is I/iS-integrable with respect to /, as follows. By Lemma 
3 of Chap, XI, there are for each k, Borel-measurable functions 
fik and vk such that 

(4:3) fik^e^ Vk, 

(4:4) Ilk dt(gk) ^ ^ dt{g^ = Vk dt{gk). 

Then jtx = l.u.b. tik and v = g.l.b. Vk are Borel-measurable and 

also satisfy conditions analogous to (4:3) and (4:4). By (2:3), 

Ihn t[t{J) — i(gjt)] = 0, and so, by (4:1) for the case of Borel- 
00 

measurable functions,* 

Since ^ wre have g, = v almost everywhere with respect to 
t(f) by Lemma 1 of Chap. XI. Thus a* = ^ almost everywhere 
with respect to t(f), and thus B is iAS-integrable with respect to 
t(f), and so also with respect to /, by Theorem 12. 

Theokemc 26. The function 6 is LS-^ntegrable with respect to /, 
and (4:1) holds, if Ai, B 2 , Ci, C 4 , Di hold. 

Proof . — ^By Theorem 4 of Chap. X, B is L/S-integrable with 
respect to each gk, and lim dgk = JB dgk. The functions 

n 

Tpn and 6 are i;S-iiitegrable with respect to /, by Theorem 25, and 
by the Corollary of Theorem 16, lim dgk = df uniformly 

k 

in n, and lim Jd dgk = df. Then (4 ;1) follows from Theorem 2 

k 

of Chap. VII. 

Lemma. 3. Suppose Aj, Bi hold. Then As holds, and 
lim Qkix + 0) = f(x + 0), lim gkix — 0) = f(x — 0) for every x 

00 oo 

on [a, 5]. 

Proof. — Since |A^*| ^ AA on every subinterval, and h has a 
right-hand limit at each point, it follows from Theorem 1 of 
Chap. VII that lim gk{x -|- s) = gkix -f 0) uniformly with 

4 * 0 + 
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respect to fc. Since the one-sided limits gh{x -f- 0), j{x 0) are 
known to exist, they may he evaluated by restricting x -f s to 
lie in the set E and, since lim ^i(a; s) = f{x -1- s) for a: d- s in 

^s=s 00 

E, we may apply Theorem 2 of Chap. VII to obtain the desired 
conclusion. 

Theorem; 27. If A3, Bi, C2, C3, D2 Md, then and B are 
LS-integrable with respect to f and to each and (4:1) holds. 

Proof. — By Theorem 7 of Chap. X, 6 is LS-integrable with 
respect to A, and hence and 6 are LS-integrable with respect 
to / and to each gk, and 

IX' - e) dg, g /X 1^, - el dh, 
l/X - e) d/ s X' 

by Theorem 16. Thus lim dgh ~ ^ uniformly with 

respect to h. We shall next show that 

(4:5) lim r ^ dgt = f ^ d/ 

for every function ^ which is L/S-integrable with respect to h, 
and then (4:1) will follow from Theorem 2 of Chap. VII. By 
definition of the integral, there is a sequence {a^ of step functions 
such that C3 and D2 hold with replaced by «« and B replaced 

rh fb 

by and hence lim / a^dgk = I ^ dgk uniformly with respect 

to by the first part of the proof. But from Lemma 3 it follows 

that lim / a^dgk— / a^df, and thus (4:5) follows from 
* Ja 

Theorem 2 of Chap. VII. 

Attention is called to the special case when the functions / and 
Qk satisfy a uniform Lipschitz condition. Then the function h(x) 
in As may be taken to be a constant multiple of Xj and the condi- 
tions C2, C3, D2 may be expressed in terms of ordinary Lebesgue 
integrals and measure. 

Theorem 28. If A4, Bi, C2, C4, D2 hold with h(x) = x^ then 
and B are LS’dntegrable with respect to f and to each gk, and (4:1) 
holds. 

Proof. — By C2, C4, D2, and Theorem 4 of Chap. X, B is Zr-inte- 
grable, and by A4 and Theorem 21, and B are LS-integrable 
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■witt respect to each gk and to /. Also 

// dgk = // dx, e dgk = Bgi dx, 

by the Corollaiy of Theorem 20. By A 4 and Theorems 28 and 20 
of Chap. X, corresponding to an arbitrary « > 0, there is a 
5 > 0 such that 

jg \g'k\ dx <e, If I dx <€, 

whenever m(E) < 5. From this it follows readily that there is a 
constant Q such that t(gk) = dx g Q, By D 2 and Theo- 

rem 18 of Chap. XI, lim m(Ene) = 0 for every e, where E^e 

n 

= — ^1 > «]. Let M be a bound for l^n(a;)l and I5(a;)|. 

Then 

I// - d) dgk\ ^ 2M f^Jgil dx + e {' \g'k\ dx g (2M + Q)e 

whenever n is sufficiently large, so that lim \[/n dgk — T 6 dgk 

uniformly in k. The remainder of the proof parallels that for 
Theorem 27. 

The folloTvdng examples illustrate the essential role of various 
hypotheses in the preceding theorems: 

1 . Let ^n(a;) = 0 for 0 ^ ^ 1 /n, Z/n ^ a: ^ 4, ^n{x) = 1 

for X = 2/nj and let be linear on the two remaining intervals. 
Let gk{x) =0 for 0 ^ x ^ 2 /fc, gk{x) = 1 for 2/k < a; ^ 4. 
Then all the hypotheses of Theorem 23 are satisfied except D 3 . 

2 . Let ^n(x) = x^^ sin (t/x) for 1/qn ^ x ^ 1 /n, == 0 

for all other values of x. Let f{x) = x^^^ cos (tt/x). Then 

(S) ypn df exists, the functions i/n are continuous and converge 
uniformly to zero but, if the sequence of integers Qn increases 
sufficiently rapidly, the sequence df diverges. By setting 

6(x) = f(x)j gk(x) = we obtain an example where all the 
hypotheses of Theorem 22 are satisfied except A 2 . 

3. Let 6{x) == cos (r/x), and let gk(x) = x sin (t/x) for 
1/qk ^ X S l/kj gjcix) = 0 for all other values of x. The 
sequence of integers qk may be so chosen that 
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9t+l 



ot = A ;+2 


Then the sequence 6 dgu does not approach zero, but all the 

hypotheses of Theorem 22 are satisfied except that B is discon- 
tinuous at one point, and all the hypotheses of Theorem 25 are 
satisfied except B 2 . 

4. Let B{x) = 1/x for 0 < x ^ 1, ^(0) = 0. Let gi{x) = 

where f{x) = x. Then 6 dgk = k + 1, and Bdf 

does not exist. All the hypotheses of Theorem 25 are satisfied 
except C 4 , and all the hypotheses of Theorem 27 are satisfied 
except that no function h can satisfy As and C 2 simultaneously. 

5. Let d(x) = 1/x ioT 0 < X ^ 1, 6(0) == 0. Let gk(x) = 0 

for 0 ^ X ^ gk(x) = x — 3^* for = ^ = Bh(^) 

= for ^ X ^1, This example has properties similar 

to the preceding, except that Jq ^dgk = Id 2, Bdf — 0. 

6. Let Q(x) = 1/x for 0 < X ^ 1, 0(0) = 0. Let gk{x) = 0 
f or 0 ^ X < 1/ft, pfc(x) = 1/fc for 1/ft g x g 1. This example 
has properties similar to those for Example 5, except that now 
As cannot be satisfied. 

Some theorems involving uniformity of convergence with 
respect to a parameter may be obtained from the preceding 
theorems by means of an indirect proof. Theorem 29 is an 
extension of Theorem 23, Theorem 30 of Theorem 27, and 
Theorem 31 of Theorem 28. We shall be concerned with families 
of functions gk<r(x), f^(x), ^n<r(x), 0<,(x), and the hypotheses will 
be chosen from among the following: 

A 2 <r. The functions gkir and are of uniformly bounded 
variation. * 

As^y. There is a nondecreasing function h(x) such that 

^ Lh, |A/,r| S Aft for every subinterval of [a, b] and every 
ft and (T. 

A 4 c. The functions gka(x) and /^(x) are absolutely continuous 
• uniformly in ft and c. 

^ Biff. There is a set E, independent of o*, dense on [a, 5] and 
including the points a and &, such that lim gkc(x) = f<r(x) 

k 

for X on E, uniformly in a. 
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C 2 <r. The functions 4^n<rix) are LS-integrable with respect to 
Kx), 

C 3 <r. The integrals J^l^rurdh are absolutely continuous with 
respect to h uniformly in n and (t. 

Cac- The functions i/ncix) and B{x) are bounded with respect to 
X, n, and cr, and B is independent of a, 

Csff. The functions and Ba{x) are continuous on [a, 6] 

uniformly with respect to a. 

D 2 <r. There is a set Ei independent of a such that mh{Ei) 
= hQ)) — h(a) and for x on Ei, lim = S{x) uni- 

n 

formly with respect to <r, where B is independent of <r. 

D 3 (r. lim ^nffix) = Bff(x) uniformly with respect to x and < 7 . 

n 

The conclusion in each of the next three theorems will be the 
validity of the statement: 

(4:6) lim \pn<r dgk^ == P B^ dfa uniformly in a. 

n= 00 •/« 

&= 00 

The existence of the integrals on the right as L/S-integrals follows 
from the preceding theorems. 

Theorem 29. A 2 <r, Bi<r, 0$^, I>Zir imply (4:6). 

Proof , — If (4:6) is false, there exist a positive number e and 
sequences (rig), (fcg), (<rg), such that and kq tend to infinity, and 

(4:7) dgk^<r^ — B^^ dfa > e. 

Let 9* = ffv. “ = f’,- From Cs, 

and Dza it follows readily that the fimctions (x) are continuous 
in X uniformly in x and q and that lim (^* — 0*) = 0 uniformly 

q 

in X. From it follows that g^ and/* are of uniformly bounded 
variation, and from Bi<r that lim g*{x) = 0 on E, Then by the 

proof of Theorem 22, lim f dg* = 0. By the Corollary of 

a 

Theorem 16, lim {f* — $*) df* = 0. Combining the last 

two statements leads to a contradiction with (4:7). 

Thboebm 30. As., Bi., Cj., Cu, Dz, imply (4:6). 
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Proof. — ^As in the proof of Theorem 29, we are led to (4:7). 
Let == ft = A- % D 2 <r, lim == 0 on 

Hi, and by Czc, the integrals /|^g j dh are absolutely continuous 
^ith respect to h uniformly in g. Hence lim */ [^*1 dh = 0, 

and then by Theorem 16, 

(4:8) lim f'^t^gt^O. 

a ^ 

By Theorem 27, 

(4:9) lim//u%:-^) =0. 

Combining the last two statements leads to a contradiction with 
(4:7), 

Theorem: 31. A 4 <r, Bi^, Cs^, and vnth h(x) = rc, imply 
* * * 

Proof. — Let gq,fq have the same meanings as in the proof 

of Theorem 30. By lim = 0 on Ei, and by C4<r the 

functions yp* are uniformly bounded. By the method used in 
proving Theorem 28 we are led to (4:8) and, by Theorem 28 
itself, to (4:9). 

The following example shows that in Theorems 30 and 31 
the condition that the function 6 is independent of <j cannot be 
omitted. Let P,* be a partition of the interval [a, b] into 2^* 
equal intervals, and let the intervals be numbered in order from 
left to right. Let a, as well as n and k, range over the positive 
integers, and let 

= 1 for X on the odd-numbered intervals of P^, 

= — 1 for rc on the even-numbered intervals of P^, 

Let gk^(z) == dk(x) dx, f^ix) = 0. Then ypna dgk<r == duOk dx 

and, when <r = h, this equals & — a. 

T’^en the functions gk{x)j f(x), gktr{x), fa{x) are absolutely 
continuous, we may apply the Corollary of Theorem 20 to 
obtain from the preceding some interesting theorems on the 
convergence of sequences of Lebesgue integrals. For example, 
the ‘^general convergence theorem” of Hobson ([2], VoL 2, page 
422) follows from Theorem 30, if we take h{x) = Kx. A theorem 
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useful in existence proofs in the calculus of variations is obtained 
from Theorem 28/^^ 

When the formula for integration by parts of Theorem 8 holds 
and 


lim ['j/n(}>)ghQ>) — = SQ>)fib) — d(a)f(a), 

71=3 eo 

ft— 00 


we obtain at once from each of the Theorems 22 to 28 a theorem 
concerning the validity of 


lim rgkdjpn= f^fdO, 

n« CO 


A corresponding statement may be made for Theorems 29 to 31. 
Moreover, the remark of the preceding paragraph may again be 
applied to give some interesting results. 

*There is a type of convergence for functions of bounded 
variation which is still weaker than Bi and which is analogous to 
convergence in the mean for L-integrable functions. It is 
defined as follows: 

Bo. lim gk(a) = /(a) ; lim gkQ>) = f{b ) ; lim j gk dx = 

k k jfc ia 

for each point c on [a, 6]. 

Bo may replace Bi in Theorems 22, 23, 27, and 28, and a 
corresponding Boo- may replace Bi^ in Theorems 29 to 31, as 
will be shown following the proof of Theorem 34. That the 
convergence of gk to / in these theorems cannot be further 
weakened is shown by the following proposition. 

*Theobem 32. If lim gk(a) = f(a), and 

k 

lim dgk = ^ df 

for every continuom function 6, then Bo holds. 

To prove this, it is sufficient to take 6(x) — 1 on [a, &], and 
then to take 

e(x) = (a; — a)/{c — a) on [a, c], 

= 1 on [c, &], 

and integrate by parts. 

^ Graves, '‘On the Existence of the Absolute Minimum in Space Problems 
of the Calculus of Variations,” Annals of Mathematics^ VoL 28 (1927), p. 162, 
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That A 2 and Bo may hold while gu does not approach / at any 
point except a and h is shown by the following simple example. 
Let guix) = — 1 on the openinteiwal (c*, di), and^jfc(a:) = Oelse- 
Tvhere on [a, &]. Let the interval (cjt, dj^ wander over [a, 6] in suit- 
able fashion, and let (d* — c&) tend to zero but not too rapidly. 

The following theorem on the compactness of a set of functions 
of uniformly bounded variation will be useful in studying the 
relationship between the twro t 3 Tpes of convergence, Bo and Bi. 

*Theorem: 33. 7/ the functions gk{x) are hounded and of 
hounded variation uniformly in k, then there exist a subsequence 
{gkf) .nnd a function f(x) such that lim gjc^ix) = f(x) everywhere on 

[a, 6]. Moreover t(J) ^ lim inf t{gkX 

g a oO 

Proof. — We suppose at first that each gkix) is nondecreasing. 
Let E he a denumerable set which is dense on [a, b] and includes 
the end points a and 6. By the “diagonal method” used in the 
proof of Ascoli’s theorem (Theorem 28 of Chap. VII), we find 
a subsequence (gk^ which converges at the points of to a 
nondecreasing function f{x) which is at first defined only on E. 
But at each point of cE, f(x) has a left-hand limit fi(x) and a 
right-hand limit fr(x). Wherever in cE fi{x) = fr{x)j we setf{x) 
equal to this common value. The remaining points where /(rc) is 
still undefined form a denumerable set, and we may select another 
subsequence, for which we use the same notation {gkX 
which converges at these points also. We may prove that gk^ix) 
converges to f(x) at the points where fi{x) = frix) as follows. 
Choose a point zinE such that x < z a,ndf(x) ^ f{z) < f(x) + €. 
Then for q sufficiently large we have 

gjcX^) ^ gkS^) < fix) + e. 

Similarly we show that gk^ix) > fix) — e. The result obtained 
for nondecreasing functions extends at once to the general case 
by the usual device. The last statement m the theorem follows 
from the fact that for each partition P of [a, 6], 

y I A/1 == lim y lAgjfcJ g lim inf 

^ 0. p 0. 

The next theorem gives the relations, between the two types of 
convergence Bo and Bi. 
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*THEOREiV[ 34. A 2 and Bi imply Bq. A 2 and Bo imply that Bi 
holds on a subsequence. 

Proof, — The first statement follows from Theorems 22 and 32. 
It could also be proved by another method. For the second 
statement, we secure a subsequence approaching a function 
fi{x) on [a, b], by Theorem 33, but fi(x) may differ from the 
function f(x) given in Bo. However, and/i also satisfy Bo, 

by the first part of the theorem, so f(x) dx == fi(x) dx 
for every point c on [a, &]. Hence f{x) = fi(x) except possibly 
at their points of discontinuity. 

We can now readily verify the statement made above that 
Bo may replace Bi in Theorems 22, 23, 27, and 28. For, if (4:1) 
does not hold, there are sequences (nf) and (kf) such that 

(4:10) lim r^n,dgk, 

Q 

exists but is different from 8 df. By Theorem 34, Bi holds 
for a subsequence of (gO- But on this subsequence the value of 

fh 

(4:10) must be / 6 df^ which is a contradiction. A similar 

device in connection with the proofs of Theorems 29 to 31 shows 
that these theorems may also be extended. 

It is interesting to note that Theorems 22, 23, 27, and 28 
with Bo' in place of Bi could have been proved directly, by 
approximating the functions by polygonal functions and 
integrating by parts. 

*5. Linear Continuous Operators on the Space S. — In preceding 
sections we have noted that the S-, GS~^ and LS-integrals are 
bilinear operators, and in particular that (8) df is defined for 
every ^ in the space S of functions continuous on the interval 
[q, b] if and only if / is of bounded variation on [a, b]. In this 
section there is given a proof of the theorem of F. Riesz which 
states that every linear continuous operator on the space S is 
expressible as a Stieltjes mtegral/^^ 

We recall that in the space E, the norm ]|^]| == l.u.b. \yp(x)\ on 
[a, b]. Continuity of a real-valued operator L with domain S 
is defined in terms of this norm in the usual way. An operator L 
is said to be modular in case there is a constant such that 

^See Biesz, Annales sdentifiques de locale normale supirieurCj Vol. 31 
(1914), pp. 9-14. 
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Il/Wl ^ mH^I! for every -p in S. It is obvious that a linear 
modular operator L is continuous. Conversely, if a linear 
operator L is continuous at ^ = 0, it is modular. For, suppose 
\L{^)\ ^ 1 whenever ||^|| ^ 5. Then 



for every xf'. 

For a linear operator L we set !|Z/|j = l.u.b. |L(^)[ for |!i^l[ = 1. 
In case ||L|] is finite, L is modular. A positive linear operator L 
is always modular, with ||L|| = jL(1), as is easily verified. The 
following theorem gives a decomposition of linear modular oper- 
ators corresponding to that for functions of bounded variation. 

Theoeem 35. If L is linear and modular^ there exist unique 
positive linear operators K, N, M, with the properties: 

1. L = K-N, 

2 . M = K + N, 

3. If L = Q — Bj where Q and R are linear and positive, then 
Q — K and R ^ N are positive. 

Moreover, ||L11 = \\M\\ = ||i?:i| + [|i\r||. 

Proof. — If xp(x) ^ 0, we set 

K(^) = l.u.b. L(d) for 0^0^^. 

Then it is plain that, if ^ ^ 0, a ^ 0, we have 

(5:1) 0 ^ K(a\ff) = < <». 

Also if ^ 0, ^2 ^ 0, we have 

(5:2) + -^(W* 

For, when 0 ^ ^ ^i, 0 ^ 02 = 4" = Li^i + 02 ) 

^ K{xpi + ^ 2 ), and hence K(xpi) + K(xl/^ ^ ^^(^i + ^ 2 ). On 
the other hand, if 0 ^ 0 ^ + ^ 2 , set 0i — (0 — ^ 2 ) V 0, 

02 = 0 A ^ 2 . Then 0i + 02 = 0, 0 ^ 0i ^ ^ 1 , 0 ^ 02 ^ ^ 2 , and 
so L(0i) ^ X(^i), L( 02 ) ^ Lie) g K(xPi) + Kixp^), and 

finally Z(^i + ^ 2 ) ^ A:(^i) + ^^(^ 2 ). 

Every continuous function xf/ has infinitely many representa- 
tions in the form ^ — ^ 2 , where ^0, ^2 0. But 

from (5:2) it follows at once that the formula Kixjl) = X(^i) 
— X(^ 2 ) defines X as a single-valued operator on ®, and from 
(5:2) and (5:1) it follows that K is linear and positive. Then 
N ^ K — L and M ^ K + N are also linear and positive. 
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Property (3) follows immediately from the definitions of K and 
iV, and the three properties together uniquely determine iT, iV”, 
and M, We note that for ^ ^ 0, we have 

M(^) = l.u.b. L{B) for — ^ ^ ^ ^ 

since M{^P) = K{2yp) ~ L(^). Hence pf |1 - M(l) ^ \\L\l But 
IILII ^ 11X11 + 1|X|| = X(l) + N(l) = M(l) == 

We shall need to extend the domain of definition of the linear 
operator i. It wiU be sufficient to consider a positive operator 
K. If (-il/n) is a bounded nondecreasing sequence of continuous 
functions, it has a limit 6, which may, however, be discontinuous. 
The sequence (Kitpn)) is also nondecreasing and bounded and 
so has a limit which we denote by K(d). From the following 
lemma we see that this definition of K(d) is consistent and yields 
a single-valued operator. 

LE!!fei^iiA4. Let (^i„) and (^2«) be nondecreasing bounded sequences 
in the space £, such that lim yf/in Hm Let K be a positive 

n n 

linear operator. Then lim X(^i/i) § lim X(^2n). 

n n 

Proof . — Suppose lim yf/in 0, where 6 is continuous, and set 

n 

A 6. Then lun ypzn = B, and in this case the conver- 

n 

gence is uniform, by Theorem 26 of Chap. VII. Hence lim K(4'zn) 
= K(9). But ^ and so lim ^ K(e). 

n 

But B may be taken as an arbitrary one of the functions yf/ 2 m* 

Let S)i denote the class of aU limits of bounded nondecreasing 
sequences (^n) chosen from £. The enlarged domain S) of the 
operators!/, K, N, and M is to consist of all functions B expressible 
as the difference of two functions chosen from It is easily 
seen that S) is linear. 

Theorem: 36. The operators K, N, L, and M may have their 
domain of definition extended to the space j) in such a way that 
they remain linear , have the same modulus on 35 as on S, and 
continue to satisfy the relations (1) and (2) of Theorem 35, and K, 
Nf and M remain positive on 35. 

Proof . — ^If ^ — 02 where 0i and 02 are limits of nondecreas- 

ing sequences, setX(B) = X(0i) — X(02), W(0) = iV(0i) — iV(02), 
L(B) - X(0) X(0), M(B) = X(0) + iV(0). If 01 and 04 are 

limits of nondecreasing sequences, it is readily verified that 
X(0i -f 04) = X(0i) + X(04), and hence that X(0) is a single- 
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valued positive linear operator on S. Since K is positive, we 
stiU have ||Z|1 = K{1). 

Theorem 37. Riesz’ Theorem. If L is a linear continuous 
operator on the space S, there is a function f of bounded variation 
such that 

\\L\\ = t(f). 

Proof. — By virtue of the preceding results, we may restrict 
attention to a positive operator K. Let 

=1 toT a ^ X ^ y, a <y Sb, 

= 0 for y < X ^hy 
Ba(x) = 0 for a i X ^ by 
f{y) = K(d,). 

If P is a partition of [a, b] by points y,-, and ^ is continuous, 

SiP; ^,f) =2 mmy,) - 

3 

3 

and this expression approaches K(\p) when the norm N{P) tends 
to zero, since then ^ — d^^^Xx)] approaches f(x) 

uniformly on [a, &]. The function / is nondecreasing, and /(a) 
= 0, f(h) = X(l) = ||ir[|. The equation \\L\\ = t(f) for the 
general case follows with the help of the Corollary of Theorem 16. 

*6. Remarks on Improper, Multiple, and Repeated Stieltjes 
Integrals. — The case when the function / is of bounded variation 
on every closed subinterval of the open interval (a, 6), but is 
not of bounded variation on (a, b), and the case when the interval 
of integration is i n finite may be handled by the methods of 
elementary calculus for improper integrals, or by the methods of 
Sec. 5 in Chap. XI. 

Multiple and repeated Stieltjes integrals of various types have 
been considered by a number of writers. In defining 

(6:1) Ifix,y)d^f(x,y), 

where I is an interval of the xy-plane, the increment of / over an 
interval i = (a, c; 6, d) is taken to be 

A(/; = m d) - fib, c) - fia, d) + fia, c). 
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as in Sec. 13 of Chap. XI. A function y) may be of bounded 

variation in the sense that ^ [A(/; 4)| is bounded for all partitions 

of the fundamental interval, without being of bounded variation 
in either variable separately. When / is of bounded variation, 
(6:1) is a linear continuous functional on the space of continuous 
fimctions defined on I. The converse theorem of Riesz, given 
in the preceding section for functions of one variable, extends 
to the case of fimctions of two or more variables.^ 

T 3 npes of repeated Stieltjes integrals are 

(6:2) y) da^(x)) dyh(y), 

(6:3) J<l>{x) y) dyh{y), 

(6:4) S^ix) dxSKy) dyf(x, y). 

The general form for a bilinear continuous functional on the 
space of continuous functions is given by (6:4), where the func- 
tion/ is of bounded variation in a modified sense. 

When f{x, y) = g(x)h(y) where g and h are of bounded varia- 
tion, Fubini's theorem shows the equality of (6:1) and (6:2) as 
I/iS-integrals, as was indicated in Chap. XI, Sec. 2. (See also 
Saks, Theory of the Integral^ page 77.) A Fubini theorem for 
(6:4) was given by Cameron and Martin.^®^ 
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